-- Logs begin at Thu 2022-06-23 11:13:32 UTC, end at Thu 2022-06-23 12:16:39 UTC. -- Jun 23 11:46:06.835549 dv-cinder-826608-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 11:46:06.846444 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 11:46:06 2022] *** Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: nodename: dv-cinder-826608-3-iscsi Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: machine: x86_64 Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: clock source: unix Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: pcre jit disabled Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: detected number of CPU cores: 4 Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: current working directory: / Jun 23 11:46:06.847618 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: detected binary path: /usr/bin/uwsgi-core Jun 23 11:46:06.848201 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: your processes number limit is 47680 Jun 23 11:46:06.848201 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: your memory page size is 4096 bytes Jun 23 11:46:06.848201 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: detected max file descriptor number: 2048 Jun 23 11:46:06.848201 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: lock engine: pthread robust mutexes Jun 23 11:46:06.848201 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: thunder lock: enabled Jun 23 11:46:06.848201 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 11:46:06.848201 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 11:46:06.891200 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: Python main interpreter initialized at 0x5586e0e6d9c0 Jun 23 11:46:06.891200 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: python threads support enabled Jun 23 11:46:06.891200 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: your server socket listen backlog is limited to 100 connections Jun 23 11:46:06.891200 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: your mercy for graceful operations on workers is 90 seconds Jun 23 11:46:06.891669 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 11:46:06.891669 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: *** Operational MODE: preforking *** Jun 23 11:46:06.891880 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: *** uWSGI is running in multiple interpreter mode *** Jun 23 11:46:06.891880 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: spawned uWSGI master process (pid: 103239) Jun 23 11:46:06.892152 dv-cinder-826608-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 11:46:06.894061 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: spawned uWSGI worker 1 (pid: 103240, cores: 1) Jun 23 11:46:06.894061 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: spawned uWSGI worker 2 (pid: 103241, cores: 1) Jun 23 11:46:06.894061 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 11:46:07.550278 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:46:07.552742 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:46:08.675418 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:46:08.675418 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: from cryptography.utils import int_from_bytes Jun 23 11:46:08.675903 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:46:08.675903 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: from cryptography.utils import int_from_bytes Jun 23 11:46:08.683052 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:46:08.683052 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: from cryptography.utils import int_from_bytes Jun 23 11:46:08.683505 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:46:08.683505 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: from cryptography.utils import int_from_bytes Jun 23 11:46:11.167340 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:46:11.167983 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:46:11.168089 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:46:11.168399 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:46:11.168846 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:46:11.168846 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:46:11.169032 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:46:11.169127 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.169208 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:46:11.169362 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.169541 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:46:11.169677 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.169802 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:46:11.169988 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.170193 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.170314 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.170524 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.170633 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.170846 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.170933 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.171166 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.171269 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.171508 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.171643 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.171783 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.171883 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.172095 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.172191 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.172413 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-3-iscsi {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.172509 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.172749 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.172860 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.173047 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.173143 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.173348 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.173434 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.173659 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.173745 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-3-iscsi {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.173958 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.174077 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.174274 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.174381 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.174571 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.174658 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.174887 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.175062 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.175193 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176193 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176299 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176388 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176475 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176550 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176624 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176740 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176819 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176887 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.176969 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.177050 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.177269 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.177359 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.177555 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.177655 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.177867 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.177955 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.178175 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.178269 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.178495 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.178589 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-3-iscsi {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.178801 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.178897 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.179126 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.179267 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.179436 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.179524 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.179833 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-3-iscsi {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.179931 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.180147 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.180239 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.180456 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.180596 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.180802 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.180894 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.181110 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.181200 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.181415 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.181517 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.181738 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.181840 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.182053 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.182149 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.182369 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.182459 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.182686 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.182773 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.182984 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.183080 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.183288 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.183388 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.183592 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.183686 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.183904 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.183993 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.184204 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.184302 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.184510 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.184608 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.184768 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.184873 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.185072 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.185168 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.185388 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.185491 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.185703 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.185805 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.185995 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.186081 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.186255 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.186349 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.186502 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.186600 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.186815 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.186916 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.187131 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.187220 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.187965 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.188107 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.188281 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.188376 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.188572 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.188702 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.188902 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.188991 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.189204 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.189291 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.189509 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.189610 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.189814 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.189909 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.190116 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.190203 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.190431 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.190602 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.190748 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.190843 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.191055 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.191141 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.191356 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.191454 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.191674 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.191809 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.191992 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.192079 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.192295 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.192391 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.192598 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.192714 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.192952 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.193039 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.193265 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.193353 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.193567 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.193661 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.193882 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.193976 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.194200 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.194288 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.194501 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.194596 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.194800 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.194889 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.195102 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.195191 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.195414 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.195502 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.195727 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.195833 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196031 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196130 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196276 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196364 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196571 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196686 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196892 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.196979 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.197204 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.197293 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.197505 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.197601 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.197806 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.197892 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.198108 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.198206 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.198400 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.198502 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.198700 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.198788 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199000 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199088 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199301 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199397 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199599 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199686 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199897 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.199990 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.200196 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.200292 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.200495 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.200583 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.200816 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.200907 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.201116 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.201206 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.201418 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.201511 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.201725 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.201853 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.202022 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.202111 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.202323 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.202410 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.202624 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.202724 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.202927 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.203041 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.203814 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.203916 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.204125 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.204213 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.204433 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.204523 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.204768 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.204879 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.205094 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.205185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.205395 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.205484 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.205700 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.205794 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206001 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206086 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206305 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206394 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206609 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206695 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206903 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.206988 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.207206 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.207295 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.207516 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.207603 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.207815 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.207910 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.208121 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.208232 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.208417 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.208541 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.208737 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.208851 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.209036 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.209125 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.209336 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.209431 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.209635 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.209731 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.209933 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.210019 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.210228 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.210322 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.210530 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.210625 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.210837 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.210988 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.211138 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.211274 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.211409 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.211557 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.211695 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.211830 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.212005 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.212140 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.212331 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.212470 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.212636 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.214118 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.214207 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.214287 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.214287 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.214449 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:46:11.214529 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.214529 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.214529 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.214529 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.214862 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.215071 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.215178 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.215413 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.215507 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.215720 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.215808 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.216025 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.216119 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.216338 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.216435 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.216651 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.216771 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.216996 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.217099 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.217305 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.217399 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.217616 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.217711 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.217931 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.218025 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.218235 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.218328 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.218547 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.218644 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.218896 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.218995 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.219210 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.219297 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.219515 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.219603 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.219852 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.219948 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.220169 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.220256 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.220487 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.220582 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.220830 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.220936 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.221146 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.221249 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.221451 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.221536 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.221785 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.221879 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.222066 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.222234 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.222380 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.222479 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.222704 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.222791 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.223013 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.223210 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.223327 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.223414 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.223634 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.223728 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.223941 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.224041 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.224247 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.224334 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.224554 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.224641 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.224915 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.225022 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.225204 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.225292 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.225515 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.225601 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.225826 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.225914 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.226135 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.226229 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.226448 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.226534 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.226759 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.226847 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.227069 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.227156 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.227376 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.227471 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.227680 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.227769 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.227981 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.228068 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.228281 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.228376 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.228587 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.228705 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.228910 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.228997 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.229225 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.229323 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.229549 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.229637 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.229851 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.229937 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.230163 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.230266 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.230470 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.230559 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.230772 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.230858 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.231077 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.231178 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.231383 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.231478 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.231685 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.231792 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.231990 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.232105 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.232295 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.232385 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.232596 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.232800 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.232942 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.233039 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.233267 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.233367 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.233549 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.233636 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.233862 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.233949 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.234160 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.234247 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.234500 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.234815 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.235041 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.235250 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.235336 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.235416 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.235486 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.235712 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.235811 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.236014 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.236104 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.236323 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.236425 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.236629 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.236739 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.236964 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.237053 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.237268 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.237365 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.237585 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.237681 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.237899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.237987 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.238212 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.238314 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.238529 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.238629 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.238838 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.238932 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.239137 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.239240 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.239443 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.239532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.239743 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.239838 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.240043 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.240133 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.240340 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.240446 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.240642 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.240749 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.240964 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.241064 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.241262 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.241357 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.241559 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.241656 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.241855 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.241944 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.242152 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.242254 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.242468 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.242568 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.242767 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.242857 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.243064 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.243152 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.243359 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.243456 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.243657 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.243746 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.243985 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.244072 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.244281 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.244378 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.244583 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.244714 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.244914 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.245002 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.245240 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.245358 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.245550 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.245641 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.245855 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.245942 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.246160 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.246261 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.246462 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.246549 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.246769 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.246858 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.247074 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.247163 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.247377 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.247465 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.247690 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.247777 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.247995 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.248085 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.248309 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.248397 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.248615 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.248788 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.248955 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.249047 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.249260 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.249347 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.249571 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.249659 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.250391 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.250522 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.250708 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.250797 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.251032 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.251137 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.251342 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.251443 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.251665 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.251754 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.251974 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.252070 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.252275 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.252368 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.252584 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.252693 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.252912 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.253009 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.253216 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.253311 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.253522 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.253611 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.253827 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.253930 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.254137 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.254226 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.254441 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.254528 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.254753 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.254849 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.255056 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.255166 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.255373 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.255494 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.255676 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.255775 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.255986 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.256072 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.256281 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.256366 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.256584 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.256705 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.256926 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.257012 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.257237 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.257326 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.257537 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.257625 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.257844 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.257936 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.258162 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.258271 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.258463 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.258559 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.258765 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.258852 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.259068 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.259163 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.259363 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.259450 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.259748 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.259964 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.260061 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.260271 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.260360 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.260572 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.260658 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.260897 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.261002 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.261200 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.261288 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.261507 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.261598 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.261809 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.261915 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.262105 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.262202 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.262401 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.262489 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.262705 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.262794 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.263018 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.263117 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.263322 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.263409 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.263636 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.263724 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.263941 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.264028 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.264238 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.264325 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.264536 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.264624 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.264870 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.264968 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.265172 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.265265 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.265473 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.266150 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.266311 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.266401 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.266611 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.266712 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.266949 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.267038 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.267254 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.267342 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.267552 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.267687 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.267858 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.267958 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.268174 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.268267 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.268481 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.268590 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.268812 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.268900 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.269119 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.269205 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.269422 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.269527 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.269739 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.269827 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.270049 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.270136 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.270354 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.270518 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.270658 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.270752 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.270964 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.271052 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.271275 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.271365 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.271581 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.271667 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.271924 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.272003 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.272187 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.272276 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.272491 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.272576 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.272816 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.272908 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.273117 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.273207 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.273422 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.273516 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.273732 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.273818 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.274044 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.274307 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.274393 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.274639 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.274727 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.274951 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.275040 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.275264 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.275357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.275576 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.275664 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.275882 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.275970 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.276194 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.276276 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.276512 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.276616 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.276877 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.277114 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.277211 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.277450 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.277538 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.277764 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.277872 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.278065 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.278184 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.278371 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.278462 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.278670 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.278759 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.278969 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.279059 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.279267 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.279363 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.279570 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.279667 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.279866 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.279968 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.280164 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.280251 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.280459 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.280557 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.280783 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.280889 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.281095 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.281184 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.281422 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.281518 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.281729 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.281818 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.282029 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.282116 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.282345 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.282433 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.282646 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.282735 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.282947 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.283047 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.283242 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.283330 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.283540 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.283632 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.283854 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.283948 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.284160 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.284247 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.284472 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.284560 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.284804 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.284902 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.285130 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.285231 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.285441 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.285529 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.285997 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.286096 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.286300 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.286462 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.286598 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.286685 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.286897 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.286986 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.287194 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.287292 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.287497 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.287585 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.287799 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.287886 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.288095 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.288193 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.288395 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.288547 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.288718 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.288810 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.289025 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.289115 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.289326 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.289415 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.289623 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.289709 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.289925 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.290014 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.290224 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.290311 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.290532 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.290627 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.290835 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.290924 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.291134 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.291230 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.291437 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.291535 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.291743 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.291833 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.292047 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.292134 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.292345 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.292449 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.292648 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.292751 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.292972 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.293087 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.293283 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.293396 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.293581 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.293679 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.293881 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.294034 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.294173 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.294387 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.294524 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.294660 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.294795 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.294929 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.295079 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.295221 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.295356 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.295498 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.295635 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.295768 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.295921 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.296065 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.296199 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.296343 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.296497 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.296626 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.296822 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.296956 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.297120 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.297253 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.297423 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.297555 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.297739 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.297882 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.298050 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.298189 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.298347 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.298492 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.298651 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.298787 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.298929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.299063 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.299225 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.299325 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.299515 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.299603 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.299818 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.299913 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.300114 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.300215 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.300413 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.300508 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.300729 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.300832 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.301031 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.301129 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.301335 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.301422 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.301641 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.301729 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.301940 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.302035 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.302239 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.302327 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.302539 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.302638 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.302837 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.302926 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.303139 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.303226 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.303451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.303539 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.303758 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.303847 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.304063 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.304149 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.304381 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.304466 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.304705 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.304794 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.305015 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.305118 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.305319 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.305414 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.305623 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.305718 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.305920 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.306005 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.306229 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.306327 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.306534 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.306660 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.306841 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.306927 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.307140 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.307236 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.307437 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.307524 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.307753 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.307839 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.308056 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.308153 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.308361 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.308449 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.308706 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.308822 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.309013 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.309119 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.309325 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.309425 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.309616 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.309704 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.309918 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.310008 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.310219 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.310315 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.310519 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.310605 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.310820 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.310909 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.311156 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.311257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.311430 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.311517 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.311819 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.311919 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.312040 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.312128 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.312346 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.312993 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.313189 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.313278 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.313491 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.313578 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.313794 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.313890 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.314098 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.314194 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.314399 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.314526 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.314709 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.314811 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315167 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315262 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315346 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315434 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315583 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315682 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315883 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.315971 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.316206 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.316294 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.316488 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.316595 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.316826 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.316926 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.317132 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.317220 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.317458 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.317549 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.317771 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.317859 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.318076 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.318163 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.318384 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.318485 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.318688 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.318779 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.318995 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.319089 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.319296 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.319444 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.319798 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.320016 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.320104 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.320323 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.320420 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.320626 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.320733 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.320947 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.321048 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.321246 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.321335 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.321551 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.321647 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.321868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.321968 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.322170 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.322262 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.322449 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.322577 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.322747 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.322921 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.323138 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.323239 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.323385 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.323474 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.323671 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.323774 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.324072 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.324163 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.324376 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.324462 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.324701 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.324792 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.325023 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.325109 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.325327 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.325418 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.325632 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.325721 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.325957 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.326056 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.326262 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.326353 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.326585 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.326677 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.326885 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.327009 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.327192 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.327292 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.327496 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.327586 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.327813 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.328012 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.328724 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.328929 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.329042 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.329243 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.329342 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.329569 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.329668 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.329890 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.329986 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.330213 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.330301 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.330516 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.330604 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.330830 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.330917 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.331137 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.331226 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.331462 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.331550 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.331785 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.331871 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.332096 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.332186 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.332412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.332499 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.332739 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.332833 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.333046 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.333134 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.333351 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.333497 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.333652 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.333821 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.333953 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.334041 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.334272 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.334392 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.334572 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.334719 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.334879 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.335028 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.335183 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.335350 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.335487 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.335679 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.335775 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.335988 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.336076 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.336294 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.336389 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.336605 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.336760 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.336939 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.337072 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.337247 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.337345 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.337573 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.337663 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.337879 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.337975 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.338177 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.338273 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.338489 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.338584 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.338789 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.338875 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.339089 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.339191 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.339387 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.339474 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.339686 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.339786 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.339998 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.340095 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.340306 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.340400 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.340617 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.340733 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.340963 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.341054 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.341289 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.341403 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.341589 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.341687 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.341911 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.342009 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.342222 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.342329 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.342529 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.342627 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.342834 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.342979 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.343124 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.343269 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.343435 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.343657 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.343813 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.343957 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.344148 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.344286 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.344481 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.344629 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.344811 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.344900 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.345115 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.345206 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.345420 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.345520 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.345719 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.345808 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.346017 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.346114 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.346314 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.346416 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.346634 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.346771 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.346936 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.347027 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.347254 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.347362 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.347558 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.347646 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.347857 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.347944 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.348158 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.348255 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.348456 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.348545 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.348786 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.348890 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.349093 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.349183 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.349396 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.349486 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.349699 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.349832 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.350018 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.350107 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.350321 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.350409 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.350632 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.350729 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.350941 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.351122 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.351247 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.351351 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.351552 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.351651 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.351855 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.351944 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.352164 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.352263 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.352474 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.352572 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.352803 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.352893 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.353114 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.353204 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.353416 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.353514 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.353728 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.353832 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.354036 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.354134 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.354346 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.354445 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.354684 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.354900 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.354988 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.355228 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.355331 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.355542 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.355631 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.355851 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.355938 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.356159 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.356262 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.356468 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.356566 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.356798 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.356891 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.357109 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.357211 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.357416 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.357509 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.357719 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.357809 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.358024 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.358290 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.358380 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.358626 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.358716 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.358947 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.359045 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.359787 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.359926 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.360105 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.360245 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.360421 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.360635 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.360843 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.360993 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.361091 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.361319 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.361408 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.361672 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.361763 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.361984 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.362075 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.362287 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.362385 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.362600 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.362690 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.362912 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.363000 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.363223 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.363392 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.363529 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.363618 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.363837 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.363938 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.364146 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.364245 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.364452 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.364550 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.364779 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.364875 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.365089 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.365180 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.365398 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.365487 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.365707 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.365805 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.366026 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.366115 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.366339 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.366426 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.366651 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.366749 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.366957 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.367044 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.367264 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.367352 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.367575 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.367681 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.367887 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.368086 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.368198 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.368396 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.368500 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.368747 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.368841 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.369069 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.369158 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.369388 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.369490 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.369698 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.369786 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.370007 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.370097 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.370326 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.370425 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.370626 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.370716 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.370925 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.371182 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.371270 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.371498 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.371588 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.371809 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.371895 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.372122 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.372219 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.372425 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.372515 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.372750 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.372843 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.373067 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.373169 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.373370 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.373459 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.373697 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.373902 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.374022 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.374250 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.374360 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.374561 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.374668 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.375472 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.375573 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.375806 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.375903 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.376117 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.376215 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.376418 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.376528 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.376758 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.376856 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.377062 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.377169 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.377365 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.377602 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.377705 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.377955 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.378052 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.378255 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.378350 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.378554 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.378652 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.378858 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.378963 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.379160 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.379258 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.379460 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.379558 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.379764 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.379869 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.380063 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.380173 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.380385 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.380489 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.380699 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.380798 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.381005 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.381118 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.381305 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.381402 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.381610 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.381709 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.381915 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.382020 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.382212 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.382354 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.382492 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.382637 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.382781 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.382926 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.383083 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.383230 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.383376 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.383514 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.383663 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.383798 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.383955 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.384100 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.384259 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.384357 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.384557 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.384715 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.384883 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.384978 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.385223 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.385313 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.385528 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.385618 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.385824 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.385911 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.386122 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.386210 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.386428 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.386517 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.386729 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.386816 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.387031 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.387183 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.387339 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.387427 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.387642 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.387730 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.387953 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.388051 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.388276 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.388364 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.388618 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.388825 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.388952 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.389155 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.389254 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.389469 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.389605 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.389796 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.389892 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.390121 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.390218 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.390422 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.390510 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.390749 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.390846 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.391047 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.391137 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.391362 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.391460 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.391667 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.391969 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.392060 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.392270 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.392356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.392576 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.392689 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.392902 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.392993 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.393206 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.393303 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.393509 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.393606 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.393811 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.393901 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.394116 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.394235 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.394417 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.394526 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.394719 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.394817 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.395021 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.395119 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.395321 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.395428 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.395626 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.395770 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.395959 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.396100 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.396272 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.396411 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.396583 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.396759 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.396916 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.397005 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.397233 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.397396 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.397537 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.397674 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.397853 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.398010 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.398168 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.398305 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.398391 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.398470 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.398701 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.398791 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.399023 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.399122 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.399331 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.399432 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.399629 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.399726 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.399969 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.400064 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.400287 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.400376 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.400600 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.400742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.400940 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.401037 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.401250 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.401344 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.401559 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.401656 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.401877 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.401966 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.402181 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.402268 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.402497 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.402600 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.402800 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.402896 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.403122 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.403219 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.403455 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.403553 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.403780 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.403868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.404098 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.404203 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.404402 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.404562 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.404770 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.404865 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.405078 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.405180 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.405381 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.405471 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.405694 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.405790 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.405999 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.406101 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.406324 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.406412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.406622 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.406711 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.406925 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.407023 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.407222 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.407310 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.407519 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.407610 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.407817 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.407951 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.408112 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.408202 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.408411 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.408508 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.408719 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.408824 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409017 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409150 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409311 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409399 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409605 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409695 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409900 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.409988 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.410193 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.410288 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.410491 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.410582 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.411041 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.411130 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.411336 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.411435 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.411629 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.411719 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.411930 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.412019 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.412224 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.412326 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.412546 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.412635 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.412894 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.412984 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.413196 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.413297 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.413502 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.413591 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.413802 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.413890 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.414111 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.414207 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.414420 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.414562 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.414711 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.414807 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.415016 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.415108 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.415318 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.415413 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.415615 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.415702 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.415939 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.416029 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.416240 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.416337 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.416544 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.416634 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.416873 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.416964 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.417176 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.417274 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.417524 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.417712 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.417793 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.417862 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.418090 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.418169 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.418413 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.418520 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.418714 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.418802 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.419032 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.419130 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.419344 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.419441 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.419656 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.419743 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.419965 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.420053 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.420271 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.420370 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.420580 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.420710 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.420912 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.421001 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.421216 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.421307 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.421527 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.421615 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.422373 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.422474 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.422678 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.422768 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.422991 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.423079 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.423302 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.423402 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.423622 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.423720 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.423936 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.424032 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.424238 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.424335 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.424623 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.424800 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.424886 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.424955 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.425217 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.425331 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.425530 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.425621 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.425847 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.425939 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.426169 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.426267 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.426482 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.426582 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.426785 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.426874 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.427084 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.427304 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.427395 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103240) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:46:11.427485 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.427745 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.428077 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.428427 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.428767 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.429119 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.429454 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.429772 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.430086 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.430394 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:46:11.430639 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103241) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:46:11.584125 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Registered counter for database nova_api Jun 23 11:46:11.590679 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Registered counter for database nova_api Jun 23 11:46:11.605637 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.610852 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.612875 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:11.617490 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:11.670051 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.context [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33ecd616-f7ab-49ff-9094-00a59936253d(cell1) {{(pid=103240) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:46:11.674498 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:11.675189 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.context [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33ecd616-f7ab-49ff-9094-00a59936253d(cell1) {{(pid=103241) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:46:11.676071 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:11.676884 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:11.678827 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_concurrency.lockutils [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103240) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:11.679110 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:11.680733 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:11.680842 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Registered counter for database nova_cell0 Jun 23 11:46:11.681538 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:46:11.683606 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:46:11.684827 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Registered counter for database nova_cell1 Jun 23 11:46:11.685621 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Registered counter for database nova_cell0 Jun 23 11:46:11.690180 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Registered counter for database nova_cell1 Jun 23 11:46:11.693250 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.694894 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.697598 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.698382 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.699795 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:11.704023 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:11.840165 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:11.849292 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:11.850727 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO dbcounter [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Registered counter for database nova_cell0 Jun 23 11:46:11.857698 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG oslo_db.sqlalchemy.engines [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103240) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.859898 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO dbcounter [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Registered counter for database nova_cell0 Jun 23 11:46:11.862814 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writer thread running {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:11.866707 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_db.sqlalchemy.engines [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103241) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:46:11.871047 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writer thread running {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:46:12.201124 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:46:12.208481 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:46:12.209161 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:46:12.215704 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:46:12.546985 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:46:12.552903 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: WARNING keystonemiddleware.auth_token [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:46:12.558189 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586e0e6d9c0 pid: 103241 (default app) Jun 23 11:46:12.558463 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:46:12.560244 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:46:12.561435 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] 10.222.0.67 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001734 Jun 23 11:46:12.561843 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 1/1] 10.222.0.67 () {50 vars in 788 bytes} [Thu Jun 23 11:46:12 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:46:12.564976 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: WARNING keystonemiddleware.auth_token [None req-8d767b9a-60f2-4cee-8ce6-5eeadf645330 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:46:12.570275 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5586e0e6d9c0 pid: 103240 (default app) Jun 23 11:47:30.225209 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:30.226378 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001616 Jun 23 11:47:30.227154 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 2/2] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:30 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:30.253840 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_api:SELECT=3 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:30.255597 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_cell1:SELECT=3 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:30.257016 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_cell0:SELECT=3 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:30.257935 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:30.698664 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-efcd8efc-3c4c-4a29-a96a-84685b723fab admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:30.729162 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-efcd8efc-3c4c-4a29-a96a-84685b723fab admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.490232 Jun 23 11:47:30.730069 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 1/3] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 23 11:47:30 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:32.835621 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:32.836628 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-494f02f5-1911-4899-8af6-248a1753d674 None None] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 23 11:47:32.837247 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 3/4] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:32 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:32.900282 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-b64ce3bb-b81e-48b7-a733-71b9ada49a2f admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 256, "disk": 1, "swap": 0, "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "id": "c1", "vcpus": 1, "os-flavor-access:is_public": true}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:32.919492 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:47:32.919492 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: warnings.warn(msg) Jun 23 11:47:32.953314 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-b64ce3bb-b81e-48b7-a733-71b9ada49a2f admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.108736 Jun 23 11:47:32.953994 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 2/5] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:32 2022] POST /compute/v2.1/flavors => generated 407 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:47:32.968877 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:32.969724 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell1:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:32.970821 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=3 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:32.971696 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:47:33.183430 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-237d2e5e-b758-4ab6-a664-abf572b3157b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:33.186119 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:47:33.186119 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 23 11:47:33.252159 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-237d2e5e-b758-4ab6-a664-abf572b3157b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.289275 Jun 23 11:47:33.252932 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 4/6] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 23 11:47:32 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:35.371927 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-b64ce3bb-b81e-48b7-a733-71b9ada49a2f admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:35.372879 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-b64ce3bb-b81e-48b7-a733-71b9ada49a2f admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Jun 23 11:47:35.374498 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 3/7] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:35 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:35.489635 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-71d2c9f4-5e06-422d-8d91-dc432a38f94e admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "ram": 512, "id": "d1", "name": "ds512M", "swap": 0, "vcpus": 1, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 5}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:35.507983 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:47:35.507983 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 23 11:47:35.526621 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-71d2c9f4-5e06-422d-8d91-dc432a38f94e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144972 Jun 23 11:47:35.527187 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 5/8] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:35 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:47:35.539649 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-589348d1-36fa-4b75-b76b-8486eed627ab admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:35.541250 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:47:35.541250 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: warnings.warn(msg) Jun 23 11:47:35.574808 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-589348d1-36fa-4b75-b76b-8486eed627ab admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039147 Jun 23 11:47:35.575506 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 4/9] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 23 11:47:35 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:37.688769 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-71d2c9f4-5e06-422d-8d91-dc432a38f94e admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:37.690438 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-71d2c9f4-5e06-422d-8d91-dc432a38f94e admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002099 Jun 23 11:47:37.691148 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 6/10] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:37 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:37.759453 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-a1dc2672-f5a7-4b16-93fd-dc70e95128c9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "name": "ds1G", "disk": 10, "vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024, "id": "d2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:37.778538 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-a1dc2672-f5a7-4b16-93fd-dc70e95128c9 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.080179 Jun 23 11:47:37.779066 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 5/11] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:47:37.791849 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-09f2a589-977a-4255-a238-6b8c33e7d49b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:37.816877 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-09f2a589-977a-4255-a238-6b8c33e7d49b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028778 Jun 23 11:47:37.817690 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 7/12] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 23 11:47:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:39.926961 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-a1dc2672-f5a7-4b16-93fd-dc70e95128c9 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:39.927979 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-a1dc2672-f5a7-4b16-93fd-dc70e95128c9 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Jun 23 11:47:39.928376 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 6/13] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:39 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:39.988660 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-4565f626-fbc9-4718-a336-facabd81155a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "disk": 10, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 2, "name": "ds2G", "ram": 2048, "rxtx_factor": 1.0, "id": "d3", "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:40.005439 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-4565f626-fbc9-4718-a336-facabd81155a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.071202 Jun 23 11:47:40.005991 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 8/14] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:47:40.018335 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-9ad26955-398f-42ff-836c-8abee9a3c89b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:40.041707 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-9ad26955-398f-42ff-836c-8abee9a3c89b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027564 Jun 23 11:47:40.042276 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 7/15] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 23 11:47:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:42.112594 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-4565f626-fbc9-4718-a336-facabd81155a admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:42.113678 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-4565f626-fbc9-4718-a336-facabd81155a admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001644 Jun 23 11:47:42.114075 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 9/16] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:42.187709 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-27b4e7e1-aa4b-4a78-bd1b-bcda80f298f6 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "id": "d4", "vcpus": 4, "swap": 0, "name": "ds4G", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "rxtx_factor": 1.0}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:42.214221 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-27b4e7e1-aa4b-4a78-bd1b-bcda80f298f6 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.091633 Jun 23 11:47:42.215005 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 8/17] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:47:42.227039 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-7d437f84-8f20-4114-adf0-3a488dc2a6e0 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:42.253473 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-7d437f84-8f20-4114-adf0-3a488dc2a6e0 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029604 Jun 23 11:47:42.254036 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 10/18] 10.222.0.67 () {64 vars in 1335 bytes} [Thu Jun 23 11:47:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:44.337905 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-27b4e7e1-aa4b-4a78-bd1b-bcda80f298f6 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:44.338916 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-27b4e7e1-aa4b-4a78-bd1b-bcda80f298f6 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001434 Jun 23 11:47:44.339470 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 9/19] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:44.402801 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-dca1321a-d3d8-4b83-808c-d717c4a28952 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:44.431557 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-dca1321a-d3d8-4b83-808c-d717c4a28952 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.085778 Jun 23 11:47:44.432188 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 11/20] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 23 11:47:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:47:46.558717 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-27b4e7e1-aa4b-4a78-bd1b-bcda80f298f6 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:46.559803 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-27b4e7e1-aa4b-4a78-bd1b-bcda80f298f6 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001415 Jun 23 11:47:46.560400 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 10/21] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:46.625532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-36223edb-c123-4b4e-8af3-8f19f78519cf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "swap": 0, "disk": 1, "id": "1", "ram": 512, "vcpus": 1}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:46.648634 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-36223edb-c123-4b4e-8af3-8f19f78519cf admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.082070 Jun 23 11:47:46.652976 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 12/22] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:46 2022] POST /compute/v2.1/flavors => generated 402 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:47:46.666101 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-246c01c8-cee1-4c81-8e26-524b7f0e887e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:46.699716 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-246c01c8-cee1-4c81-8e26-524b7f0e887e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.041811 Jun 23 11:47:46.700360 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 11/23] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 23 11:47:46 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:48.861627 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-36223edb-c123-4b4e-8af3-8f19f78519cf admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:48.862627 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-36223edb-c123-4b4e-8af3-8f19f78519cf admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 23 11:47:48.863022 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 13/24] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:48 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:48.925779 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-68bc1cc4-6b86-4e6a-abe1-aa574d3a274b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.small", "swap": 0, "vcpus": 1, "ram": 2048, "disk": 20, "id": "2", "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:48.944267 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-68bc1cc4-6b86-4e6a-abe1-aa574d3a274b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.075471 Jun 23 11:47:48.944838 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 12/25] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:48 2022] POST /compute/v2.1/flavors => generated 405 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:47:48.957880 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-9bc94633-05ce-4d99-80f9-ca4cd4d2049b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:48.981857 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-9bc94633-05ce-4d99-80f9-ca4cd4d2049b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027885 Jun 23 11:47:48.982427 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 14/26] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 23 11:47:48 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:47:51.101517 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-68bc1cc4-6b86-4e6a-abe1-aa574d3a274b admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:51.102531 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-68bc1cc4-6b86-4e6a-abe1-aa574d3a274b admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Jun 23 11:47:51.102934 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 13/27] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:51.164981 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-cc2aec7e-d97f-4e9e-9b7c-3687155fc243 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true, "vcpus": 2, "ram": 4096, "swap": 0, "id": "3", "rxtx_factor": 1.0, "name": "m1.medium", "disk": 40}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:51.183301 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-cc2aec7e-d97f-4e9e-9b7c-3687155fc243 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.073714 Jun 23 11:47:51.183879 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 15/28] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:51 2022] POST /compute/v2.1/flavors => generated 406 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:47:51.196227 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-4e690372-e265-49e3-a0a8-da5134895c0e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:51.220453 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-4e690372-e265-49e3-a0a8-da5134895c0e admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027842 Jun 23 11:47:51.221086 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 14/29] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 23 11:47:51 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:53.339916 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-cc2aec7e-d97f-4e9e-9b7c-3687155fc243 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:53.341033 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-cc2aec7e-d97f-4e9e-9b7c-3687155fc243 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001531 Jun 23 11:47:53.341652 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 16/30] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:53.401242 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-92fc1787-ba7c-4660-a884-dea1442d9e31 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "4", "name": "m1.large", "os-flavor-access:is_public": true, "ram": 8192, "disk": 80, "rxtx_factor": 1.0, "vcpus": 4, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:53.420623 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-92fc1787-ba7c-4660-a884-dea1442d9e31 admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.072601 Jun 23 11:47:53.421229 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 15/31] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:53 2022] POST /compute/v2.1/flavors => generated 405 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:47:53.433222 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-b87d315c-8ba7-4f6c-bb77-22647557736a admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:53.458431 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-b87d315c-8ba7-4f6c-bb77-22647557736a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028832 Jun 23 11:47:53.459020 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 23 11:47:53 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:47:55.554998 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-92fc1787-ba7c-4660-a884-dea1442d9e31 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:47:55.556297 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-92fc1787-ba7c-4660-a884-dea1442d9e31 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001792 Jun 23 11:47:55.556860 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 16/33] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:47:55.615447 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-eb9048ef-972a-4659-91e7-9d6d4a50aa3d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 160, "id": "5", "vcpus": 8, "rxtx_factor": 1.0, "ram": 16384, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:55.632956 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-eb9048ef-972a-4659-91e7-9d6d4a50aa3d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.069600 Jun 23 11:47:55.633685 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 18/34] 10.222.0.67 () {64 vars in 1282 bytes} [Thu Jun 23 11:47:55 2022] POST /compute/v2.1/flavors => generated 408 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:47:55.645371 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-0a846dc9-ea60-4350-a7a0-1e3151547e7b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:47:55.669468 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-0a846dc9-ea60-4350-a7a0-1e3151547e7b admin admin] 10.222.0.67 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.027668 Jun 23 11:47:55.670676 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 17/35] 10.222.0.67 () {64 vars in 1332 bytes} [Thu Jun 23 11:47:55 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 29 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:48:20.698107 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-eb9048ef-972a-4659-91e7-9d6d4a50aa3d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:20.699156 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-eb9048ef-972a-4659-91e7-9d6d4a50aa3d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 23 11:48:20.699494 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 19/36] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:48:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:20.709986 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:20.759301 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-a4950827-774d-4ebf-a765-23bd8f647e52 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:20.776113 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-a4950827-774d-4ebf-a765-23bd8f647e52 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.070725 Jun 23 11:48:20.776647 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 18/37] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 23 11:48:20 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:48:21.695095 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-eb9048ef-972a-4659-91e7-9d6d4a50aa3d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:21.696084 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-eb9048ef-972a-4659-91e7-9d6d4a50aa3d admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001410 Jun 23 11:48:21.696482 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 20/38] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:21.885694 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-c1c2ea8b-f412-42a6-80ac-f8569ecede66 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:21.891299 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.wsgi [None req-c1c2ea8b-f412-42a6-80ac-f8569ecede66 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-c1c2ea8b-f412-42a6-80ac-f8569ecede66 admin admin] Request method failure captured: Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Accept: application/json Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Accept-Encoding: gzip, deflate Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Connection: keep-alive Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Content-Length: 0 Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Host: 10.222.0.67 Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Openstack-Api-Version: compute 2.90 Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Openstack-System-Scope: None Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: User-Agent: python-novaclient Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Auth-Token: gAAAAABitFMFTSm6XaTApo7XBH196CjnYw7fzYa3xTN--N7ZGHN5mJ6Y3MGfM_byRiUyxz7oxVfFT3jkY32Q44-_Zo7lQLYQfGKPXfk75jCU0nNI6Yzh9L22j7mfboAp7wFdZOT4V0dWcHKWv4eSYVAAqvPZACwQcnkRsmQmxhlQBV2a8-OQ-8Q Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Domain-Id: None Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Domain-Name: None Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Identity-Status: Confirmed Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Is-Admin-Project: True Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Domain-Id: default Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Domain-Name: Default Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Name: admin Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Role: member,reader,admin Jun 23 11:48:21.894569 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Roles: member,reader,admin Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e503e3101124c66a9726948b602dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e503e3101124c66a9726948b602dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant: admin Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant-Name: admin Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User: admin Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Domain-Id: default Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Domain-Name: Default Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Id: 86b831b5471b48e6bf2bf9ce771279b2 Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Name: admin Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: method: > Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: exception: Flavor 42 could not be found. Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: action_args: {'id': '42'} Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:48:21.896290 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:21.897790 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.899185 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-c1c2ea8b-f412-42a6-80ac-f8569ecede66 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:48:21.900644 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-c1c2ea8b-f412-42a6-80ac-f8569ecede66 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.064592 Jun 23 11:48:21.900644 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 23 11:48:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 66 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:21.905957 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-2b32153d-50c3-4bee-bf56-468f66c29180 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:21.908907 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:48:21.928555 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-2b32153d-50c3-4bee-bf56-468f66c29180 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.026279 Jun 23 11:48:21.929132 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 21/40] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 23 11:48:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:48:21.939299 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-3c17decd-1445-4701-9df7-48f0ec19b3eb admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:21.968818 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-3c17decd-1445-4701-9df7-48f0ec19b3eb admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.033564 Jun 23 11:48:21.969378 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 20/41] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 23 11:48:21 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:48:21.979193 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-2da18948-5acb-40d2-bb36-6f59278b689e admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:21.986194 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-2da18948-5acb-40d2-bb36-6f59278b689e admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-2da18948-5acb-40d2-bb36-6f59278b689e admin admin] Request method failure captured: Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Accept: application/json Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Connection: keep-alive Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Content-Length: 0 Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Host: 10.222.0.67 Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABitFMFTSm6XaTApo7XBH196CjnYw7fzYa3xTN--N7ZGHN5mJ6Y3MGfM_byRiUyxz7oxVfFT3jkY32Q44-_Zo7lQLYQfGKPXfk75jCU0nNI6Yzh9L22j7mfboAp7wFdZOT4V0dWcHKWv4eSYVAAqvPZACwQcnkRsmQmxhlQBV2a8-OQ-8Q Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Domain-Id: None Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Domain-Name: None Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Name: admin Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Role: member,reader,admin Jun 23 11:48:21.989451 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Roles: member,reader,admin Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e503e3101124c66a9726948b602dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e503e3101124c66a9726948b602dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant: admin Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User: admin Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Id: 86b831b5471b48e6bf2bf9ce771279b2 Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Name: admin Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: method: > Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: exception: Flavor 42 could not be found. Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: action_args: {'id': '42'} Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:48:21.990958 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:21.991868 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:21.992954 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-2da18948-5acb-40d2-bb36-6f59278b689e admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:48:21.993946 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-2da18948-5acb-40d2-bb36-6f59278b689e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.015276 Jun 23 11:48:21.993946 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 22/42] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 23 11:48:21 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 11:48:22.811374 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-3c17decd-1445-4701-9df7-48f0ec19b3eb admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:22.812391 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-3c17decd-1445-4701-9df7-48f0ec19b3eb admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001436 Jun 23 11:48:22.812827 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 21/43] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:23.002563 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a5e75c66-c0c1-4881-97dd-fecb146bd0fe admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:23.009933 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-a5e75c66-c0c1-4881-97dd-fecb146bd0fe admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a5e75c66-c0c1-4881-97dd-fecb146bd0fe admin admin] Request method failure captured: Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Accept: application/json Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Connection: keep-alive Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Content-Length: 0 Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Host: 10.222.0.67 Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABitFMGaUXgyU10LoavWS4TyJWZdnIxd5WwnkG2VoGu33JmMV9vIrWaVll99WCdn9jeQop2H9Q7MgWTwByq-rHkFxK4HVgd-M4vvmEOxE9fwky6l8lZYk2jC23CwNnaoa1_Ks6QulEO-I62ctUlEmnLBoxrcZo_Cvqu0pFgur7iSb_uprE Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Domain-Id: None Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Domain-Name: None Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Name: admin Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Role: member,reader,admin Jun 23 11:48:23.011412 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Roles: member,reader,admin Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e503e3101124c66a9726948b602dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e503e3101124c66a9726948b602dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant: admin Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User: admin Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Id: 86b831b5471b48e6bf2bf9ce771279b2 Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Name: admin Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: method: > Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: exception: Flavor 84 could not be found. Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: action_args: {'id': '84'} Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:48:23.012912 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:23.014532 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.015899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-a5e75c66-c0c1-4881-97dd-fecb146bd0fe admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:48:23.017201 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-a5e75c66-c0c1-4881-97dd-fecb146bd0fe admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.062457 Jun 23 11:48:23.017201 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 23/44] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 23 11:48:22 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:23.023152 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-8beab46b-be4f-4313-8c8b-7d18219027c9 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:23.036820 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-8beab46b-be4f-4313-8c8b-7d18219027c9 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017158 Jun 23 11:48:23.037341 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 22/45] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 23 11:48:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:48:23.046824 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-039377a9-bc50-48d4-aaff-ad21aa1e8b37 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:23.060859 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-039377a9-bc50-48d4-aaff-ad21aa1e8b37 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016985 Jun 23 11:48:23.061403 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 23 11:48:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:48:23.070787 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-95aa0a7e-8a4d-4190-8852-4f19a51e04d2 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:23.076848 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.wsgi [None req-95aa0a7e-8a4d-4190-8852-4f19a51e04d2 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-95aa0a7e-8a4d-4190-8852-4f19a51e04d2 admin admin] Request method failure captured: Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Accept: application/json Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Accept-Encoding: gzip, deflate Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Connection: keep-alive Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Content-Length: 0 Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Host: 10.222.0.67 Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Openstack-Api-Version: compute 2.90 Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Openstack-System-Scope: None Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: User-Agent: python-novaclient Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Auth-Token: gAAAAABitFMGaUXgyU10LoavWS4TyJWZdnIxd5WwnkG2VoGu33JmMV9vIrWaVll99WCdn9jeQop2H9Q7MgWTwByq-rHkFxK4HVgd-M4vvmEOxE9fwky6l8lZYk2jC23CwNnaoa1_Ks6QulEO-I62ctUlEmnLBoxrcZo_Cvqu0pFgur7iSb_uprE Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Domain-Id: None Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Domain-Name: None Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Identity-Status: Confirmed Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Is-Admin-Project: True Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Domain-Id: default Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Domain-Name: Default Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Name: admin Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Role: member,reader,admin Jun 23 11:48:23.078343 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Roles: member,reader,admin Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e503e3101124c66a9726948b602dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e503e3101124c66a9726948b602dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant: admin Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant-Name: admin Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User: admin Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Domain-Id: default Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Domain-Name: Default Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Id: 86b831b5471b48e6bf2bf9ce771279b2 Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Name: admin Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: method: > Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: exception: Flavor 84 could not be found. Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: action_args: {'id': '84'} Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:48:23.079735 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:23.080612 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:23.081742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-95aa0a7e-8a4d-4190-8852-4f19a51e04d2 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:48:23.082740 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-95aa0a7e-8a4d-4190-8852-4f19a51e04d2 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.012707 Jun 23 11:48:23.082740 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 23/47] 10.222.0.67 () {60 vars in 1190 bytes} [Thu Jun 23 11:48:23 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Jun 23 11:48:23.889967 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-039377a9-bc50-48d4-aaff-ad21aa1e8b37 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:23.890981 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-039377a9-bc50-48d4-aaff-ad21aa1e8b37 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 23 11:48:23.891375 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 25/48] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:24.080090 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-a80915fe-ddfe-4602-8557-bbbaaae69862 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:24.085857 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.wsgi [None req-a80915fe-ddfe-4602-8557-bbbaaae69862 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-a80915fe-ddfe-4602-8557-bbbaaae69862 admin admin] Request method failure captured: Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Accept: application/json Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Accept-Encoding: gzip, deflate Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Connection: keep-alive Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Content-Length: 0 Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Host: 10.222.0.67 Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Openstack-Api-Version: compute 2.90 Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Openstack-System-Scope: None Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: User-Agent: python-novaclient Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Auth-Token: gAAAAABitFMH4dYqb4KmNfQ6QvIq2wJ9Ep-O9550qQSpFOhHKGPGC7rESPkQBGfI7XukPurWdUfbay5yPSj4x-LYN53G1r8h5-u5EJEEy04smPwBcydjv72mJLYKQg5p0dMZv1dhu_49is_TY0BKoCLQPrQ9_rcMLT6Z75m_nPb6Csj7Cz09Ve4 Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Domain-Id: None Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Domain-Name: None Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Identity-Status: Confirmed Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Is-Admin-Project: True Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Domain-Id: default Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Domain-Name: Default Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Project-Name: admin Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Role: member,reader,admin Jun 23 11:48:24.087357 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Roles: member,reader,admin Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e503e3101124c66a9726948b602dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e503e3101124c66a9726948b602dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant: admin Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-Tenant-Name: admin Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User: admin Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Domain-Id: default Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Domain-Name: Default Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Id: 86b831b5471b48e6bf2bf9ce771279b2 Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: X-User-Name: admin Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: method: > Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: exception: Flavor 451 could not be found. Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: action_args: {'id': '451'} Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:48:24.088929 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:24.089831 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.091136 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-a80915fe-ddfe-4602-8557-bbbaaae69862 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103240) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:48:24.092992 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-a80915fe-ddfe-4602-8557-bbbaaae69862 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.061210 Jun 23 11:48:24.092992 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 24/49] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 23 11:48:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:24.098999 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-86a876bc-2adb-40ce-8166-61bcacca7c7d admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:24.112401 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-86a876bc-2adb-40ce-8166-61bcacca7c7d admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.016952 Jun 23 11:48:24.112944 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 26/50] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 23 11:48:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:48:24.122300 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:24.136052 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] 10.222.0.67 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017261 Jun 23 11:48:24.136591 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 25/51] 10.222.0.67 () {60 vars in 1210 bytes} [Thu Jun 23 11:48:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:48:24.146352 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-64a51f84-6e52-4293-95a4-f66201c87a49 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:24.151726 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.wsgi [None req-64a51f84-6e52-4293-95a4-f66201c87a49 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-64a51f84-6e52-4293-95a4-f66201c87a49 admin admin] Request method failure captured: Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Accept: application/json Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Accept-Encoding: gzip, deflate Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Connection: keep-alive Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Content-Length: 0 Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Host: 10.222.0.67 Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Openstack-Api-Version: compute 2.90 Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Openstack-System-Scope: None Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: User-Agent: python-novaclient Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Auth-Token: gAAAAABitFMH4dYqb4KmNfQ6QvIq2wJ9Ep-O9550qQSpFOhHKGPGC7rESPkQBGfI7XukPurWdUfbay5yPSj4x-LYN53G1r8h5-u5EJEEy04smPwBcydjv72mJLYKQg5p0dMZv1dhu_49is_TY0BKoCLQPrQ9_rcMLT6Z75m_nPb6Csj7Cz09Ve4 Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Domain-Id: None Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Domain-Name: None Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Identity-Status: Confirmed Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Is-Admin-Project: True Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Openstack-Nova-Api-Version: 2.90 Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Domain-Id: default Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Domain-Name: Default Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Project-Name: admin Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Role: member,reader,admin Jun 23 11:48:24.153257 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Roles: member,reader,admin Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/1e503e3101124c66a9726948b602dc87"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/1e503e3101124c66a9726948b602dc87"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_1e503e3101124c66a9726948b602dc87"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant: admin Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant-Id: 1e503e3101124c66a9726948b602dc87 Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-Tenant-Name: admin Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User: admin Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Domain-Id: default Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Domain-Name: Default Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Id: 86b831b5471b48e6bf2bf9ce771279b2 Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: X-User-Name: admin Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: method: > Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: exception: Flavor 451 could not be found. Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: action_args: {'id': '451'} Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:48:24.155356 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:24.156252 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: ERROR nova.api.openstack.wsgi Jun 23 11:48:24.157574 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-64a51f84-6e52-4293-95a4-f66201c87a49 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103241) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:48:24.158852 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-64a51f84-6e52-4293-95a4-f66201c87a49 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.012375 Jun 23 11:48:24.158852 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 27/52] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 23 11:48:24 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 23 11:48:24.987865 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:24.988899 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Jun 23 11:48:24.989298 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 26/53] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:25.179305 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-028e77c7-6b19-490a-b333-d519f885d20a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:25.197298 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-028e77c7-6b19-490a-b333-d519f885d20a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.070437 Jun 23 11:48:25.197767 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 28/54] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 23 11:48:25 2022] POST /compute/v2.1/flavors => generated 404 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:48:26.029739 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:26.030761 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001962 Jun 23 11:48:26.031152 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 27/55] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:26 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:26.219873 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-8c1d14b6-02e4-45e4-bdbd-07d6f846dd6c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:26.237846 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-8c1d14b6-02e4-45e4-bdbd-07d6f846dd6c admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.069475 Jun 23 11:48:26.238470 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 29/56] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 23 11:48:26 2022] POST /compute/v2.1/flavors => generated 405 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:48:27.065256 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:27.066270 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Jun 23 11:48:27.066666 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 28/57] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:27.256873 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-757f5680-9f32-41ce-b5a2-417a49e7089a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:27.273746 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-757f5680-9f32-41ce-b5a2-417a49e7089a admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.069523 Jun 23 11:48:27.274286 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 30/58] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 23 11:48:27 2022] POST /compute/v2.1/flavors => generated 407 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:48:28.094499 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:28.095528 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 23 11:48:28.095930 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 29/59] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:28.285486 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-d5f7d0e8-061d-4617-ae02-f0bed228c93d admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:48:28.305892 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-d5f7d0e8-061d-4617-ae02-f0bed228c93d admin admin] 10.222.0.67 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.072854 Jun 23 11:48:28.306396 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 31/60] 10.222.0.67 () {64 vars in 1235 bytes} [Thu Jun 23 11:48:28 2022] POST /compute/v2.1/flavors => generated 409 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:48:29.130908 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:29.131921 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Jun 23 11:48:29.132315 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 30/61] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:48:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:48:29.320915 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-c732df80-785a-4189-95b9-d8df2caf978e admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:48:29.340233 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-c732df80-785a-4189-95b9-d8df2caf978e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071074 Jun 23 11:48:29.340716 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 32/62] 10.222.0.67 () {60 vars in 1202 bytes} [Thu Jun 23 11:48:29 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:16.407570 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:16.408583 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-493b6c48-ecc5-4ed0-b375-49b01718f2df admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Jun 23 11:49:16.409019 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 31/63] 10.222.0.67 () {54 vars in 930 bytes} [Thu Jun 23 11:49:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:49:16.419638 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:16.471888 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-1a0e148a-378e-4171-b00a-aca3c97ddbb8 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:16.490806 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-1a0e148a-378e-4171-b00a-aca3c97ddbb8 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.075587 Jun 23 11:49:16.491359 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 33/64] 10.222.0.67 () {60 vars in 1291 bytes} [Thu Jun 23 11:49:16 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:49:16.515058 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-1c6cc0f2-aa08-4f76-8d4b-87c22a20abf4 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:16.518573 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG dbcounter [-] [103240] Writing DB stats nova_api:SELECT=14 {{(pid=103240) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:49:16.524415 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-1c6cc0f2-aa08-4f76-8d4b-87c22a20abf4 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013634 Jun 23 11:49:16.525019 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 32/65] 10.222.0.67 () {60 vars in 1282 bytes} [Thu Jun 23 11:49:16 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 15 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:49:16.536400 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-100625b6-1aa3-4393-9830-53c24eac005e admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:16.544237 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-100625b6-1aa3-4393-9830-53c24eac005e admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011363 Jun 23 11:49:16.545286 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 34/66] 10.222.0.67 () {60 vars in 1285 bytes} [Thu Jun 23 11:49:16 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:49:16.556459 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:16.564531 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011691 Jun 23 11:49:16.565083 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 33/67] 10.222.0.67 () {60 vars in 1285 bytes} [Thu Jun 23 11:49:16 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:49:16.576048 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-61bc70fa-d346-4b17-9097-4c5b7f780703 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:49:16.584456 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-61bc70fa-d346-4b17-9097-4c5b7f780703 admin admin] 10.222.0.67 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011866 Jun 23 11:49:16.585041 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 35/68] 10.222.0.67 () {60 vars in 1282 bytes} [Thu Jun 23 11:49:16 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:52:34.012171 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:34.013215 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Jun 23 11:52:34.013651 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 34/69] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:52:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:34.154662 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=6 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:34.269024 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-18299043-c8c8-43a6-bdb8-ff3ef5daa4f9 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:34.270193 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:34.270193 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 23 11:52:34.271396 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-18299043-c8c8-43a6-bdb8-ff3ef5daa4f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:34.271866 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-18299043-c8c8-43a6-bdb8-ff3ef5daa4f9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:34.272696 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-18299043-c8c8-43a6-bdb8-ff3ef5daa4f9 admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:34.273116 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-18299043-c8c8-43a6-bdb8-ff3ef5daa4f9 admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:34.306592 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-18299043-c8c8-43a6-bdb8-ff3ef5daa4f9 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.153301 Jun 23 11:52:34.307142 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 36/70] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 23 11:52:34 2022] GET /compute/v2.1/os-services => generated 791 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:52:35.150711 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:35.151742 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001470 Jun 23 11:52:35.152132 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 35/71] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:52:35 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:35.350823 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-632243fe-4846-4886-827f-e71e2492378c admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:35.351995 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:35.351995 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 23 11:52:35.353202 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-632243fe-4846-4886-827f-e71e2492378c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:35.353671 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-632243fe-4846-4886-827f-e71e2492378c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:35.354475 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-632243fe-4846-4886-827f-e71e2492378c admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:35.354899 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-632243fe-4846-4886-827f-e71e2492378c admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:35.375548 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-632243fe-4846-4886-827f-e71e2492378c admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.90 time: 0.079040 Jun 23 11:52:35.376594 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 37/72] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 23 11:52:35 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:52:46.631182 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:46.632196 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001423 Jun 23 11:52:46.632599 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 36/73] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:52:46 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:52:46.775294 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell0:SELECT=4 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:46.776010 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_cell1:SELECT=4 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:46.776789 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG dbcounter [-] [103241] Writing DB stats nova_api:SELECT=8 {{(pid=103241) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:52:46.825419 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-7deb46f6-27a7-4355-b3c9-66de8cc904c1 admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:46.826570 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:46.826570 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 23 11:52:46.827732 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-7deb46f6-27a7-4355-b3c9-66de8cc904c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:46.828164 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-7deb46f6-27a7-4355-b3c9-66de8cc904c1 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:46.829009 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-7deb46f6-27a7-4355-b3c9-66de8cc904c1 admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:46.829428 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-7deb46f6-27a7-4355-b3c9-66de8cc904c1 admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:46.854259 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-7deb46f6-27a7-4355-b3c9-66de8cc904c1 admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.083333 Jun 23 11:52:46.854737 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 38/74] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 23 11:52:46 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:52:47.687853 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: DEBUG nova.api.openstack.wsgi [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] Calling method '>' {{(pid=103240) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:47.688902 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: INFO nova.api.openstack.requestlog [None req-cf36203c-c9e6-4b7c-aee5-8d8474898656 admin admin] 10.222.0.67 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001427 Jun 23 11:52:47.689322 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: [pid: 103240|app: 0|req: 37/75] 10.222.0.67 () {56 vars in 1074 bytes} [Thu Jun 23 11:52:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:52:47.881522 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG nova.api.openstack.wsgi [None req-673f4a5d-4044-421c-9fbb-a035652100ad admin admin] Calling method '>' {{(pid=103241) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:52:47.882679 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 23 11:52:47.882679 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: warnings.warn(msg) Jun 23 11:52:47.883861 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-673f4a5d-4044-421c-9fbb-a035652100ad admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:47.884319 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-673f4a5d-4044-421c-9fbb-a035652100ad admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:47.885191 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-673f4a5d-4044-421c-9fbb-a035652100ad admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:52:47.885612 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: DEBUG oslo_concurrency.lockutils [None req-673f4a5d-4044-421c-9fbb-a035652100ad admin admin] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103241) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:52:47.907320 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: INFO nova.api.openstack.requestlog [None req-673f4a5d-4044-421c-9fbb-a035652100ad admin admin] 10.222.0.67 "GET /compute/v2.1/os-services" status: 200 len: 1035 microversion: 2.90 time: 0.078753 Jun 23 11:52:47.907799 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: [pid: 103241|app: 0|req: 39/76] 10.222.0.67 () {60 vars in 1193 bytes} [Thu Jun 23 11:52:47 2022] GET /compute/v2.1/os-services => generated 1035 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:53:47.899590 dv-cinder-826608-3-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 23 11:53:47.900498 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: Thu Jun 23 11:53:47 2022 - graceful shutdown triggered... Jun 23 11:53:47.901054 dv-cinder-826608-3-iscsi devstack@n-api.service[103240]: Gracefully killing worker 1 (pid: 103240)... Jun 23 11:53:47.901496 dv-cinder-826608-3-iscsi devstack@n-api.service[103241]: Gracefully killing worker 2 (pid: 103241)... Jun 23 11:53:48.902188 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: worker 1 buried after 1 seconds Jun 23 11:53:48.902188 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: worker 2 buried after 1 seconds Jun 23 11:53:48.902188 dv-cinder-826608-3-iscsi devstack@n-api.service[103239]: goodbye to uWSGI. Jun 23 11:53:48.903864 dv-cinder-826608-3-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 23 11:53:48.904666 dv-cinder-826608-3-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 23 11:53:48.907934 dv-cinder-826608-3-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 23 11:53:48.917922 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: *** Starting uWSGI 2.0.18-debian (64bit) on [Thu Jun 23 11:53:48 2022] *** Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: nodename: dv-cinder-826608-3-iscsi Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: machine: x86_64 Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: clock source: unix Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: pcre jit disabled Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: detected number of CPU cores: 4 Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: current working directory: / Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: detected binary path: /usr/bin/uwsgi-core Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: your processes number limit is 47680 Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: your memory page size is 4096 bytes Jun 23 11:53:48.919879 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: detected max file descriptor number: 2048 Jun 23 11:53:48.920770 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: lock engine: pthread robust mutexes Jun 23 11:53:48.920770 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: thunder lock: enabled Jun 23 11:53:48.920770 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 23 11:53:48.920770 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 23 11:53:48.966062 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: Python main interpreter initialized at 0x55cbd90c89c0 Jun 23 11:53:48.966062 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: python threads support enabled Jun 23 11:53:48.966062 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: your server socket listen backlog is limited to 100 connections Jun 23 11:53:48.966062 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: your mercy for graceful operations on workers is 90 seconds Jun 23 11:53:48.966525 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: mapped 403077 bytes (393 KB) for 2 cores Jun 23 11:53:48.966525 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: *** Operational MODE: preforking *** Jun 23 11:53:48.966811 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: *** uWSGI is running in multiple interpreter mode *** Jun 23 11:53:48.966811 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: spawned uWSGI master process (pid: 117726) Jun 23 11:53:48.967019 dv-cinder-826608-3-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 23 11:53:48.967625 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: spawned uWSGI worker 1 (pid: 117746, cores: 1) Jun 23 11:53:48.968141 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: spawned uWSGI worker 2 (pid: 117747, cores: 1) Jun 23 11:53:48.968428 dv-cinder-826608-3-iscsi devstack@n-api.service[117726]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 23 11:53:49.641483 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:53:49.642107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 23 11:53:50.869159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:53:50.869159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: from cryptography.utils import int_from_bytes Jun 23 11:53:50.869159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:53:50.869159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: from cryptography.utils import int_from_bytes Jun 23 11:53:50.875671 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:53:50.875671 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: from cryptography.utils import int_from_bytes Jun 23 11:53:50.876771 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 23 11:53:50.876771 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: from cryptography.utils import int_from_bytes Jun 23 11:53:53.313655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:53:53.314247 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:53:53.314518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:53:53.314848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:53:53.315112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:53:53.315523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.315856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.316194 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.316520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.316925 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.317222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.317548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.317882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.318215 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.318487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.318815 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.319149 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-3-iscsi {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.319480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.319793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.320115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.320444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.321358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.321695 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.322010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.322532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.323854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.323854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.323854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.324134 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.324317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.324580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.324940 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.325259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.325592 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.325911 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.326329 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-3-iscsi {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.326659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.326981 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.327303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.327739 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.328061 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.328380 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.328731 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.329068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.329384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.329721 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.330049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.330375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.330706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.331015 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.331330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.331649 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.331977 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.332290 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.332602 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.332888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.333206 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.333560 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.333875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.334189 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.334448 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.334704 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.335031 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.335358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.335671 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.335986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.336339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.336656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.336996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.337311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.337624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.337938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.338266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.338587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.339017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.339307 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.339548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.339967 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.340226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.340540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.340925 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.341251 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.341565 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.342332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.342332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.342647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.343039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.343184 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.343430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.343778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.344096 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.344353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.344696 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.345000 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.345329 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.345645 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.346951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.346951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.346951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.346951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.347559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.347559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.347842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.348064 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.348377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.348721 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.349021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.349347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.349660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.349989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.350306 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.350621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.351002 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.351249 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.351723 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 23 11:53:53.352730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.352900 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 23 11:53:53.353055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.353055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.353338 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 23 11:53:53.353489 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.353641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 23 11:53:53.355903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.356083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 23 11:53:53.356259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.356419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.356566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.356749 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.356923 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.357078 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.357253 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.357401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.359077 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.359492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.359691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.359853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.360010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.360171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.360318 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.360476 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.360622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.360791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.360936 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.361099 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.361343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.361525 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.361679 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.361679 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.361968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-826608-3-iscsi {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.362120 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.362287 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.362433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.362584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.362740 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.362885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.363029 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.363188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.363341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.363485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.363628 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.363771 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.363921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.364092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.364249 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.364402 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.365143 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.365302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.365472 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.365625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.365769 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.365915 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.366067 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.366220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.366392 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.366538 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.366691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.366847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.366992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.367145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.367300 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.367447 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.368136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.368292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.368445 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.368607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.368778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.368946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-826608-3-iscsi {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.369099 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.369251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.369413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.369589 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.369740 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.369885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.370036 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.370181 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.370339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.370496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.370649 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.370803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.370956 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.371112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.371271 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.371518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.371671 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.371816 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.371967 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.372127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.372426 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.372577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.372790 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.372955 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.373120 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.373322 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.373481 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.373627 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.373771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.373924 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.374069 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.374229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.374382 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.374535 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.374680 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.374825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.374969 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.375138 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.375283 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.375445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.375603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.375757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.377022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.377147 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.377230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.377305 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.377384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.377465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.377553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.377654 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.377730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.377800 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.377880 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.377960 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.378047 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.378119 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.378198 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.378270 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.378339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.378418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.378490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.378560 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.378638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.378711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.378711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.378852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.378930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.379009 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.379087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.379158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.379235 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.379316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.379387 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.379457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.379526 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.379632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.379732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.379831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.379914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.380020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.380101 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.380174 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.380174 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.380317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.67 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.380388 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.380466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.67 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.380545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.380616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.380776 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.380861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.380935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.381014 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.381093 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.381199 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.381289 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.381362 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.381433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.381510 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.381582 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.381651 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.381734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.381815 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.381894 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.381966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.382044 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.382130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.382203 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.382282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.382362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.382435 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.382435 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.382600 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.382675 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.382746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.382816 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.382886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.382956 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.383035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.383117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.383196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.383275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.383353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.383425 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.383509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.383590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.383662 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.384224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.384518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.384635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.384798 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.384929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.385047 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.385164 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.385282 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.385401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.385519 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.385644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.385762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.385879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.385989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.386106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.386229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.386341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.386457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.386577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.387424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.387567 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.387691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.387811 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.387930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.388041 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.388151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.388260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.388386 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.388498 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.388615 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.388831 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.389008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.389156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.389308 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.389462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.389614 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.389768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.389925 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.390069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.390212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.390363 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.390518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.390669 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.390822 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.390965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.391107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.391250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.391407 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.391407 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.391689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.391689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.391976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.392126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.392279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.392423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.392567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.392822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.392986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.393138 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.393296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.393449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.393593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.393745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.393900 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.394053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.394196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.394345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.394488 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.394637 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.394789 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.394950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.395103 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.395248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.395397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.395540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.395692 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.395844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.395987 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.396130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.396280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.396431 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.396575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.396840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.397476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.397807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 23 11:53:53.397962 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.398106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.398250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.398414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.398560 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.398710 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.398856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.399017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.399186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.399331 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.399476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.399619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.399760 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.399910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.400063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.400207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.400361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.400511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.400713 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.401423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.401593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.401738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.401882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.402025 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.402176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.402330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.402474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.402617 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.402772 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.402922 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.403067 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.403219 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.403363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.403514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.403665 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.403809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.403963 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.404122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.404273 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.404417 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.404417 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.404729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.404894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.405049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.405194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.405337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.405490 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.405641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.405641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.405931 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.406084 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.406236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.406387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.406531 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.406693 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.406837 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.406979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.407713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.407976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.408126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.408284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.408453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.408716 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.408869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.409036 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.409182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.409341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.409497 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.409647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.409791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.409956 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.410100 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.410257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.410402 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.410545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.410696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.410841 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.410992 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.411145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.411308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.411461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.411613 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.411765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.411923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.412068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.412219 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.412362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.412516 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.412685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.412852 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.413004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.413148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.413301 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.413451 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.413602 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.413759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.413918 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.414070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.414220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.415007 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.415209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.415369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.415517 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.415661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.415811 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.415974 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.416126 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.416277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.416421 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.416563 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.416813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.416972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.417130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.417942 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.418197 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.418355 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.418500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.418689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.418951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.419104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.419256 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.419401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.419551 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.419710 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.419863 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.420006 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.420157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.420300 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.420492 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.420713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.420866 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.421032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.421184 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.421328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.421479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.421636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.421780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.421923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.422073 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.422224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.422367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.422523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.422675 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.422828 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.422972 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.423122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.423279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.423435 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.423579 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.423722 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.423872 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.424017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.424169 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.424380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.424640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.424852 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.425021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.425233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.425404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.425550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.425694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.425844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.425987 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.426196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.426196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.426627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.426774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.426954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.427135 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.428410 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.428577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.428741 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.428893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.428893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.429311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.429473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.429618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.429763 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.429905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.430631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.430784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.431069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.431069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.431366 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.431512 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.431664 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.431808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.431950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.432092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.432234 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.432386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.432537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.432746 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.432897 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.433051 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.433206 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.433359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.433505 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.433648 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.433789 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.434015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.434171 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.434325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.434470 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.434620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.434771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.434915 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.435077 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.435229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.435381 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.435533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.435691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.435836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.435988 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.436140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.436284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.436434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.436578 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.436739 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.436907 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.437069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.437221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.437364 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.437527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.437752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.438316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.438582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.438909 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.439068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.439339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.439491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.439646 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.439791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.439954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.440108 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.440260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.440413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.440557 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.440758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.440919 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.441071 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.441216 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.441367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.441518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.441677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.441832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.441983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.442126 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.442282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.442427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.442568 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.442710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.442852 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443147 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443297 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443440 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443582 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443742 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.443903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.444182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.444333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.444482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.444632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.444819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.444966 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.445117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.445260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.445402 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.445552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.445718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.445892 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.446052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.446196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.446347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.446505 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.446659 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.446802 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.446945 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.447096 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.447240 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.447393 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.447537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.447698 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.447945 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.448489 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.448760 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.448926 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.449073 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.449226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.449480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.449631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.449784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.449943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.450088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.450242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.450395 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.450539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.450692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.450844 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.450987 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.451130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.451274 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.451416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.451569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.451713 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.451863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.452008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.452215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.452377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.452537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.452713 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.452875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.453020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.453163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.453314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.453473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.453617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.453769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.453912 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.454056 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.454223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.454368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.454512 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.454653 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.454804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.454947 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.455139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.455285 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.455428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.455580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.455731 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.455875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.456027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.456189 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.456341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.456492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.456637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.456819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.456975 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.457127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.457279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.457438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.457583 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.457741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.457893 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.458134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.458688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.458951 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.459111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.459276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.459426 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.459679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.459830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.459974 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.460126 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.460285 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.460429 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.460571 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.460771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.460934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.461079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.461233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.461385 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.461537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.461681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.461825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.461977 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.462129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.462129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.462410 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.462410 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.462690 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.462913 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.463058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.463216 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.463369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.463522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.463684 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.463935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.464086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.464237 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.464382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.464382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.464653 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.464853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.464999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.465143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.465294 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.465294 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.465580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.465737 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.465889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.466034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.466177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.466319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.466476 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.466629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.466791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.466935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.467094 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.467245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.467245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.467539 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.467681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.467824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.467965 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.468128 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.468398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.469188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.469364 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.469594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.469741 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.469908 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.470153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.470304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.470455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.470614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.470765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.470909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.471052 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.471204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.471354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.471523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.471669 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.471820 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.471820 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.472092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.472236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.472389 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.472542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.472704 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.472867 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.473012 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.473171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.473317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.473479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.473624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.473775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.473927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.474083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.474235 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.474386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.474584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.474752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.474905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.475060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.475212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.475356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.475511 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.475661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.475804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.475962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.476107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.476257 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.476400 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.476552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.476760 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.477417 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.477562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.477705 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.477870 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.478015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.478168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.478340 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.478598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.479396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.479553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.479709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.479865 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.480011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.480173 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.480449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.480608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.480790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.480951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.481104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.481256 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.481400 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.481543 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.481703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.481848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.481991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.482134 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.482276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.482276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.482561 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.482717 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.482862 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.485444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.485654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.485811 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.485976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.486125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.486269 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.486412 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.486565 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.486725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.486878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.487037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.487195 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.487347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.487347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.487631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.487776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.487927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.488080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.488223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.488374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.488594 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.488888 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.489701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.489880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.490028 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.490172 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.490326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.490490 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.490768 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.490918 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.491062 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.491215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.491375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.491529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.491673 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.491824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.491994 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.492161 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.492320 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.492511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.493251 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.493405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.493405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.493702 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.493854 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.494011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.494162 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.494320 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.494471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.494641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.494801 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.494953 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.495103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.495262 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.495422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.495581 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.495731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.495889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.496039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.496188 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.496353 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.496512 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.496714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.496886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.497048 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.497207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.497367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.497519 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.497676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.497835 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.497985 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.498135 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.498299 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.498458 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.498690 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.498867 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.499156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.499939 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.500103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.500255 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.500414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.500566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.500797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.501087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.501245 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.501404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.501555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.501721 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.501872 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.502035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.502187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.502344 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.502505 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.502664 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.502824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.502985 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.503144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.503303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.503462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.503612 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.503781 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.503946 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.504096 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.504247 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.504396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.504554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.504813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.504974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.505126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.505285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.505444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.505603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.505769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.505941 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.506092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.506242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.506392 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.506549 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.506709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.506870 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.507029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.507179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.507328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.507485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.507485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.507795 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.507953 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.508171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.508341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.508501 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.508653 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.508653 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.509005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.509293 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.509293 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.510298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.510453 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.510453 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.510760 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.510921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.511107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.511391 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.511391 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.511683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.511833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.511833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.512135 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.512285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.512285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.512586 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.512772 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.512950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.513102 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.513102 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.513396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.513545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.513545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.513853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.514011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.514011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.514308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.514458 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.514617 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.514775 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.514944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.515103 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.515342 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.515512 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.515680 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.515839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.515990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.516147 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.516147 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.516433 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.516592 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.516804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.516970 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.517129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.517280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.517430 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.517593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.517745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.517745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.518038 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.518196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.518365 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.518525 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.518683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.518841 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.519017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.519176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.519431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.519698 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.520171 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.520418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.520576 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.520757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.520930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.521083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.521233 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.521233 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.521630 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.521798 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.521964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.522115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.522265 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.522414 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.522566 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.522730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.522890 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.523056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.523206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.523206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.523501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.523501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.523862 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.524014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.524164 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.524164 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.524449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.524612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.524845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.525010 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.525171 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.525330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.525495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.525665 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.525824 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.525824 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.526162 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.526312 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.526473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.526624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.526786 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.526943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.526943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.527227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.527387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.527549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.527707 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.527868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.528026 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.528251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.528412 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.528563 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.528745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.528904 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.529056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.529220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.529371 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.529619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.529879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.530376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.530656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.530825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531109 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531307 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531307 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531496 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531592 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531699 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.531963 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532064 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532299 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532371 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532452 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532533 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532717 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532794 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532872 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.532958 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533032 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533253 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533806 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.533958 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534091 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534318 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534472 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534623 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534859 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.534938 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535082 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535241 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535470 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535701 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535781 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.535940 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536173 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536324 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536860 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.536860 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537077 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537147 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537623 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.537935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538006 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538077 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538236 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538533 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538693 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538853 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.538925 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.539003 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.539085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.539158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.539229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.539982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.540072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.540165 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.540632 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.540749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.540839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.540923 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541240 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541383 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541454 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541613 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541753 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541824 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.541974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542676 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.542973 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543043 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543043 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543189 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543733 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.543966 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544276 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544348 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544507 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.544935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.545063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.545155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.545384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.545481 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.545708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.545974 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.546056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.546314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.546404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.546637 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.546719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.546954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.547050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.547271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.547406 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.547588 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.547705 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.547906 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.548048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.548222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.548341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.548536 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.548655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.548909 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.549049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.549268 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.549389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.549601 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.549728 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.549941 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.550224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.550370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.550893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551033 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551388 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551508 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551838 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.551964 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.552075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.552194 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.552352 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.552483 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.552699 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.552837 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.553024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.553146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.553350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.553614 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.553744 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.553942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.554075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.554272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.554394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.554607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.554744 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.555654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.555825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.556168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.556493 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.556903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.557179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.557514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.557866 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.558209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.558548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.558865 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.559179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.559347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.559499 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.559739 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.560805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.560941 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561193 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561445 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.561995 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.562145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.562295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.562463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.562651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.562853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.563019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.563177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.563434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.563596 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.563782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.564063 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.564277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.564435 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.564787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.564969 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.565289 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.565458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.565624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.565624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.566174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.566335 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.566335 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.566633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.566793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.566953 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.567177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.567339 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.567490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.567641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.567793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.567970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.568130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.568282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.568441 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.568592 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.568783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.568948 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.569107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.569258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.569416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.569566 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.569716 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.569881 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.570043 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.570200 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.570358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.570516 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.571262 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.571703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.572114 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.572367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.572586 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.572827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.573048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.573220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.573383 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.573383 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.573684 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.573836 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.573997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.574148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.574148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.574443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.574606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.574765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.574926 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.574926 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.575233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.575544 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.575544 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.575859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.576019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.576019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.576470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.576628 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.576628 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.576966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.577119 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.577289 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.577448 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.577624 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.577773 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.577933 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.578083 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.578253 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.578467 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.578630 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.578781 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.578941 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.579091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.579250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.579408 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.579559 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.579734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.579885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.580034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.580183 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.580332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.580482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.580640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.581090 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.581454 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.581627 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.581890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.582066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.582344 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.582529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.582681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.582839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583001 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583402 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117747) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:53:53.583555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.583555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.584564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.584564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.584564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.585022 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.585022 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.585316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.585647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.585950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.586303 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.586640 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.586963 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.587284 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.587644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.587970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.588564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.588935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.589271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.589621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.589965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.590283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.590600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.590916 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.591343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.591682 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.591861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.592165 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.593075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.593075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.593392 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.593543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.593734 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.594051 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.594368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.594683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.595000 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.595418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.595627 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.596016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.596417 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.596813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.597123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.597459 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.597777 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.598096 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.598415 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.598735 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.599067 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.599403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.599724 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.600039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.600581 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.600930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.601260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.601748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.602626 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.602800 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.603097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.603379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.603707 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.604023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.604363 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.605410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.605410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.605410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.605926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.606206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.606370 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.606593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.606991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.607230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.607631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.607837 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.608153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.608465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.608943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.609128 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.609434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.609749 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.610124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.610436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.610747 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.611058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.611373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.611684 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.611999 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.612310 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.612620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.612954 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.613270 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.613583 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.613925 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.614268 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.614590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.614920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.615245 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.615570 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.615885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.616214 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.616547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.616896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.617212 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.618111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.618435 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.618754 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.619075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.619392 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.619712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.620033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.620364 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.620719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.621028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.621362 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.621740 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.622011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.622328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.622648 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.622982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.623346 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.623625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.623942 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.624257 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.624572 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.624919 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.625241 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.625575 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.625905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.626219 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.626550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.626883 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.627236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.627555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.627905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.628238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.628558 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.628903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.629216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 23 11:53:53.629468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=117746) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 23 11:53:53.644485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO dbcounter [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Registered counter for database nova_api Jun 23 11:53:53.668377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_db.sqlalchemy.engines [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.674848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writer thread running {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:53.692712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO dbcounter [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Registered counter for database nova_api Jun 23 11:53:53.713415 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_db.sqlalchemy.engines [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.720117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writer thread running {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:53.733091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.context [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33ecd616-f7ab-49ff-9094-00a59936253d(cell1) {{(pid=117747) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:53:53.737236 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.738859 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.739746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.741673 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.743714 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO dbcounter [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Registered counter for database nova_cell0 Jun 23 11:53:53.747872 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO dbcounter [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Registered counter for database nova_cell1 Jun 23 11:53:53.755827 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_db.sqlalchemy.engines [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.757523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_db.sqlalchemy.engines [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.763719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writer thread running {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:53.765439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writer thread running {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:53.779282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.context [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),33ecd616-f7ab-49ff-9094-00a59936253d(cell1) {{(pid=117746) load_cells /opt/stack/nova/nova/context.py:464}} Jun 23 11:53:53.786385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.790380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.791961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:53:53.796158 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:53:53.799161 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO dbcounter [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Registered counter for database nova_cell0 Jun 23 11:53:53.803836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO dbcounter [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Registered counter for database nova_cell1 Jun 23 11:53:53.811668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_db.sqlalchemy.engines [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.814465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_db.sqlalchemy.engines [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.819354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writer thread running {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:53.822141 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writer thread running {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:53.928077 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO dbcounter [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Registered counter for database nova_cell0 Jun 23 11:53:53.936204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_db.sqlalchemy.engines [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117747) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.942261 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writer thread running {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:53.982609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO dbcounter [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Registered counter for database nova_cell0 Jun 23 11:53:53.989552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_db.sqlalchemy.engines [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=117746) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 23 11:53:53.996104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writer thread running {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 23 11:53:54.265203 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: WARNING keystonemiddleware.auth_token [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:53:54.274747 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: WARNING keystonemiddleware.auth_token [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:53:54.326780 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: WARNING keystonemiddleware.auth_token [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:53:54.334243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: WARNING keystonemiddleware.auth_token [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:53:54.616566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: WARNING keystonemiddleware.auth_token [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:53:54.623309 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: WARNING keystonemiddleware.auth_token [None req-b113457f-9767-4c48-9549-12333a8e4ff0 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:53:54.629059 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbd90c89c0 pid: 117747 (default app) Jun 23 11:53:54.683030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: WARNING keystonemiddleware.auth_token [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 23 11:53:54.689187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: WARNING keystonemiddleware.auth_token [None req-e6eaa19d-aaa4-418d-8039-355f6d28b9fd None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 23 11:53:54.694625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55cbd90c89c0 pid: 117746 (default app) Jun 23 11:54:36.292358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:36.296188 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:36.296188 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:36.296188 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:37.793371 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d31273e2-a4e0-4ad5-8f0b-8f498c6c9ff2 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Action: 'create', calling method: .version_select at 0x7f3ae7f5d700>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-324356431", "metadata": {"Type": "work"}}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:39.509329 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d31273e2-a4e0-4ad5-8f0b-8f498c6c9ff2 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 3.224742 Jun 23 11:54:39.509995 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 1/1] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 23 11:54:36 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 3227 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 11:54:39.824260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f27df70e-0d9a-4bec-ad0e-863640bf19eb tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Calling method '.version_select at 0x7f3ae800d280>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:39.851864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:39.853216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:39.854386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:39.855734 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:54:40.592955 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f27df70e-0d9a-4bec-ad0e-863640bf19eb tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695" status: 200 len: 353 microversion: 2.1 time: 1.073976 Jun 23 11:54:40.593540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 1/2] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 11:54:39 2022] GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695 => generated 353 bytes in 1076 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:40.605877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1a00be02-ba3c-4ea6-a50a-9073644e7d76 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Calling method '.version_select at 0x7f3ae7e24550>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:40.710684 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1a00be02-ba3c-4ea6-a50a-9073644e7d76 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695" status: 200 len: 353 microversion: 2.1 time: 0.109433 Jun 23 11:54:40.711483 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 2/3] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 11:54:40 2022] GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695 => generated 353 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:40.742650 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f2378807-62a7-4d28-8dba-007988bae0cd tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Calling method '.version_select at 0x7f3ae7e635e0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:40.848709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f2378807-62a7-4d28-8dba-007988bae0cd tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695" status: 202 len: 0 microversion: 2.1 time: 0.122929 Jun 23 11:54:40.849589 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 2/4] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 11:54:40 2022] DELETE /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695 => generated 0 bytes in 125 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:54:40.858034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8c2a8afc-52f0-4658-9c3f-1d5605c99cf4 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Calling method '.version_select at 0x7f3ae7e24670>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:40.979392 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8c2a8afc-52f0-4658-9c3f-1d5605c99cf4 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695" status: 200 len: 352 microversion: 2.1 time: 0.125056 Jun 23 11:54:40.980783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 3/5] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 11:54:40 2022] GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695 => generated 352 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:54:41.993287 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-632f366b-1b9f-478d-aa13-d9d233e09018 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Calling method '.version_select at 0x7f3ae7e63790>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:42.076073 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-632f366b-1b9f-478d-aa13-d9d233e09018 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] HTTP exception thrown: Volume 38d909ac-7956-498b-9b54-3879ad8df695 could not be found. Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-632f366b-1b9f-478d-aa13-d9d233e09018 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Request method failure captured: Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695 HTTP/1.1 Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFR8k9GVvx1GyPa4IqD_TOl9mKJ9N_6qfR8nECP3yDf67eyGjVDJcEDOGBkY1v-wxJX1F_FIKq5-iYKTJULH5Z5ZWnTnle7PNogTPcmX7pzWfnsN9gMCxo19Ox0U8e7t2dixtmIFq8OBffJEQReIc8J5fJwxLrFlQ4XeD4hDKJeg8Fk Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: d7fe1b47df3c48c3b8d069af1c78eb44 Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-VolumesGetTestJSON-680823218 Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 11:54:42.080807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d7fe1b47df3c48c3b8d069af1c78eb44"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d7fe1b47df3c48c3b8d069af1c78eb44"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d7fe1b47df3c48c3b8d069af1c78eb44"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d7fe1b47df3c48c3b8d069af1c78eb44"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-VolumesGetTestJSON-680823218 Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: d7fe1b47df3c48c3b8d069af1c78eb44 Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-VolumesGetTestJSON-680823218 Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-VolumesGetTestJSON-680823218-project Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: df627cb95dcf4706b67b34b2996250e5 Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-VolumesGetTestJSON-680823218-project Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Volume 38d909ac-7956-498b-9b54-3879ad8df695 could not be found. Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '38d909ac-7956-498b-9b54-3879ad8df695'} Jun 23 11:54:42.082110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 38d909ac-7956-498b-9b54-3879ad8df695 could not be found. (HTTP 404) (Request-ID: req-d11af221-a74e-4a71-b64c-4ef7472a1d51) Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:54:42.113663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 11:54:42.116638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 38d909ac-7956-498b-9b54-3879ad8df695 could not be found. Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 11:54:42.120842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 38d909ac-7956-498b-9b54-3879ad8df695 could not be found. Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 38d909ac-7956-498b-9b54-3879ad8df695 could not be found. Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-632f366b-1b9f-478d-aa13-d9d233e09018 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] Returning 404 to user: Volume 38d909ac-7956-498b-9b54-3879ad8df695 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-632f366b-1b9f-478d-aa13-d9d233e09018 tempest-VolumesGetTestJSON-680823218 tempest-VolumesGetTestJSON-680823218-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695" status: 404 len: 109 microversion: 2.1 time: 0.093550 Jun 23 11:54:42.122973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 3/6] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 11:54:41 2022] GET /compute/v2.1/os-volumes/38d909ac-7956-498b-9b54-3879ad8df695 => generated 109 bytes in 96 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:54:50.729230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-2009922964", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:51.015652 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] validate_networks() for [('fc58067c-4167-4106-9d1e-ab7bc831a394', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:54:54.233751 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:54:54.234883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:54:54.236038 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:54:54.236661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:54:54.237347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:54:54.278465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:54.281049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:54.283201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:54.285400 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:54.391116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:54:54.412511 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for user 53f1188f2446493baae7dc79bbb66ff7 and project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:54:54.451117 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:54:54.462928 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:54:54.722266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2dff1e21-c3e2-4658-b4e9-d94c39dde129 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.301294 Jun 23 11:54:54.723519 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 4/7] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:54:50 2022] POST /compute/v2.1/servers => generated 383 bytes in 4304 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:54:54.734782 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-249079bc-8465-41d9-b7db-08ab0234d8a7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:54.735722 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-249079bc-8465-41d9-b7db-08ab0234d8a7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:55.111412 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-249079bc-8465-41d9-b7db-08ab0234d8a7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:55.161593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-249079bc-8465-41d9-b7db-08ab0234d8a7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1222 microversion: 2.1 time: 0.429688 Jun 23 11:54:55.176706 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 4/8] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:54 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1222 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:55.712842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-277555368", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "networks": [{"uuid": "8240784e-7d18-4da2-9bd8-69d0ccf85cc0"}]}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:55.799932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] validate_networks() for [('8240784e-7d18-4da2-9bd8-69d0ccf85cc0', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:54:55.867399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-185082400", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:56.255065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] validate_networks() for [('fc58067c-4167-4106-9d1e-ab7bc831a394', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:54:58.526854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:54:58.530018 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:54:58.539391 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:54:58.540513 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:54:58.541242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:54:58.562710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:58.563531 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:58.564576 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:58.573094 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:58.617430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Getting quotas for project 6c041fd4759140b6926efa8c1a4935f7. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:54:58.626095 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Getting quotas for user c3435419f72349b68c62a76638f98812 and project 6c041fd4759140b6926efa8c1a4935f7. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:54:58.666567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:54:58.680786 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:54:58.798848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e507f3a9-6485-44fd-a621-e8863ae8665c tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.687037 Jun 23 11:54:58.799513 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 5/9] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:54:55 2022] POST /compute/v2.1/servers => generated 380 bytes in 3689 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:54:59.099033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:54:59.099033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:54:59.099033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:54:59.099033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:54:59.101059 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:54:59.140567 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:59.144806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:59.146056 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:54:59.151167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:54:59.222022 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:54:59.229840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for user 53f1188f2446493baae7dc79bbb66ff7 and project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:54:59.252092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:54:59.275237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:54:59.452136 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-419746c8-27f6-4b65-ad19-97fb58a48242 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.588760 Jun 23 11:54:59.453351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 5/10] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:54:55 2022] POST /compute/v2.1/servers => generated 383 bytes in 3591 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:54:59.463109 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4c113ba0-5922-4e21-9436-c8916dc0a48e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:59.469233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4c113ba0-5922-4e21-9436-c8916dc0a48e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:59.716634 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-378c5743-a8e2-4f24-a31c-0af4c9175f11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'create', calling method: .version_select at 0x7f3ae74ce820>, body: {"keypair": {"name": "tempest-keypair-11104482", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKdVGulHQfELzdSVZWXSqaB/dlzIACWIK75AqikaOcqlrvHFl2o/ZA8o1LqvHe+ZbYUgS0JjJlaj0WEcDhIYv93Q8A5nMl6PjVq5EOpQnYMnhwTg1Nd2cuJmRRasRqHkXA=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:54:59.813874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-378c5743-a8e2-4f24-a31c-0af4c9175f11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for project d211354c655b469491d235e5507e61ba. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:54:59.846088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4c113ba0-5922-4e21-9436-c8916dc0a48e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:54:59.849892 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-378c5743-a8e2-4f24-a31c-0af4c9175f11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for user ebfb5a6c657a4fd592ff9e67348627eb and project d211354c655b469491d235e5507e61ba. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:54:59.857491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4c113ba0-5922-4e21-9436-c8916dc0a48e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1214 microversion: 2.1 time: 0.401042 Jun 23 11:54:59.862847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 6/11] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:59 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1214 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:54:59.880215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9fe3277f-382d-483e-90bc-aa6c7383f054 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:54:59.896817 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9fe3277f-382d-483e-90bc-aa6c7383f054 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:54:59.995942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-378c5743-a8e2-4f24-a31c-0af4c9175f11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 1.195145 Jun 23 11:54:59.999964 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 6/12] 10.222.0.67 () {62 vars in 1199 bytes} [Thu Jun 23 11:54:58 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 1200 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 23 11:55:00.265220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9fe3277f-382d-483e-90bc-aa6c7383f054 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:00.278518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9fe3277f-382d-483e-90bc-aa6c7383f054 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1221 microversion: 2.1 time: 0.412583 Jun 23 11:55:00.282085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 7/13] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:54:59 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1221 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:00.878297 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-57d492fa-262b-4138-8cc5-65e01dc3820a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:00.878910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-57d492fa-262b-4138-8cc5-65e01dc3820a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:00.912457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3a9b477f-28d8-40e2-82ea-ba4d0a594528 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'create', calling method: .version_select at 0x7f3ae74d39d0>, body: {"keypair": {"name": "tempest-keypair-238375666", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBx0zOk9eeIe3upfWuET7f8WA4KR8SiHBClwj3A9ioMUOIBzYcRWdcAXPqquXzHbzkHPwlzz3ikOYeitOCAtjCB3a+llzW00HL7y5DtMrZDATqM6dEnEWGpGN+YYq7QV6A=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:00.970184 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-3a9b477f-28d8-40e2-82ea-ba4d0a594528 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:55:00.976405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-3a9b477f-28d8-40e2-82ea-ba4d0a594528 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for user 9ab84989dd384d15b316b20cc65e792a and project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:55:01.024834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3a9b477f-28d8-40e2-82ea-ba4d0a594528 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.533875 Jun 23 11:55:01.025661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 7/14] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 11:55:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 535 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:01.295864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:01.296633 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:01.333510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:01.338466 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:01.348548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:01.350951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:01.480127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-57d492fa-262b-4138-8cc5-65e01dc3820a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:01.498922 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-57d492fa-262b-4138-8cc5-65e01dc3820a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1214 microversion: 2.1 time: 0.625773 Jun 23 11:55:01.504049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 8/15] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:00 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1214 bytes in 633 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:01.991848 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ad78509c-1b95-4858-aab4-01635c9fef5f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: .version_select at 0x7f3ae7450f70>, body: {"keypair": {"name": "tempest-keypair-1722598700", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBO6nvy9eTJg9wWA6t5nC2fPzUwgX4EpwQ1EGKK/B+cyb4HBU5PQ80pKT6b64yt/U03bAFFsFnLPtHSD5yPHfjCbM5lAQblFk0295itSLBbmF77wYu8vvFomChk/RRPZ5PA=="}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:02.070705 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-ad78509c-1b95-4858-aab4-01635c9fef5f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:55:02.087672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-ad78509c-1b95-4858-aab4-01635c9fef5f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:55:02.189618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ad78509c-1b95-4858-aab4-01635c9fef5f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.413296 Jun 23 11:55:02.192460 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 9/16] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 11:55:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:02.525818 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:02.527155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:02.557569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:02.558257 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:02.563731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:02.568065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:03.034055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:03.082745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ebaedc21-bd3b-4159-b5cf-c6d44c433936 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1273 microversion: 2.1 time: 1.791053 Jun 23 11:55:03.085476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 8/17] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:01 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1273 bytes in 1795 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:03.442788 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:03.490584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4ea54c18-1cf3-4aa7-a475-399934fee3d0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1266 microversion: 2.1 time: 0.968836 Jun 23 11:55:03.494632 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 10/18] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:02 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1266 bytes in 975 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:04.118792 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:04.122843 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:04.168170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.170118 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.171801 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.172583 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.525854 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:04.530664 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:04.578145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.581580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.587362 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:04.592153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:04.746313 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:04.759319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-90206110-3438-42bd-8b83-adadd405b206 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1279 microversion: 2.1 time: 0.661270 Jun 23 11:55:04.773631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 9/19] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:04 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1279 bytes in 676 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:05.093276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:05.109068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9cf12661-d1a4-4e94-ac75-04adf09b7d96 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1272 microversion: 2.1 time: 0.599831 Jun 23 11:55:05.115674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 11/20] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:04 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1272 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:05.780763 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:05.781400 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:05.800006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:05.800685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:05.802322 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:05.802749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:06.007540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:06.027097 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-14dab890-f4d8-44ba-9129-edc1ccb33d84 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1279 microversion: 2.1 time: 0.239993 Jun 23 11:55:06.027831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 10/21] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:05 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1279 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:06.133753 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:06.135467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:06.156632 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:06.157422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:06.162549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:06.163033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:06.873477 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:06.935149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-79540275-f1ed-4e93-a9f2-2ee03286c6e3 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1272 microversion: 2.1 time: 0.800083 Jun 23 11:55:06.939112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 12/22] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:06 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1272 bytes in 811 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:07.048877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:07.049741 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:07.062947 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:07.063847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:07.064945 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:07.069111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:07.306141 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:07.318217 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-11991bab-45ff-4f09-b802-7189f59594f7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1279 microversion: 2.1 time: 0.277606 Jun 23 11:55:07.330191 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 11/23] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:07 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1279 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:07.965034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:07.966643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:07.994301 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:07.997035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:08.002131 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:08.002887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:08.338804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:08.340048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:08.349481 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:08.353187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:08.354197 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:08.358090 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:08.597428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=4 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:08.983720 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:08.996570 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-df1d14ee-1776-4ad8-b350-1477e3da5787 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1279 microversion: 2.1 time: 0.663452 Jun 23 11:55:09.011656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 12/24] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:08 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1279 bytes in 678 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:09.193764 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:10.018121 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:10.019381 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:10.040117 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:10.042790 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:10.044114 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:10.048090 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:10.992961 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=20 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:11.055332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:11.072183 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b222d090-97b7-4552-aab8-df4049084974 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1279 microversion: 2.1 time: 1.056154 Jun 23 11:55:11.091984 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 13/25] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:10 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1279 bytes in 1079 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:12.097569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:12.098205 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:12.099805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=18 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:12.120164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:12.131587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:12.136839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:12.137324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:12.320357 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:12.342935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c16cfae6-df81-4a18-b51d-229a08ea67ea tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1279 microversion: 2.1 time: 0.237997 Jun 23 11:55:12.346546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 14/26] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:12 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1279 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:12.560000 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:12.576889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9d605d81-62b1-4d79-bb5e-a1f70e2b7b4e tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 4.622719 Jun 23 11:55:12.580336 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 13/27] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:07 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 4629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:13.363768 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:13.367158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:13.381872 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.384043 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.385617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.386067 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.663524 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-02599ffa-fde3-4d65-b179-1df82f0a7eac req-24cd4179-1dc1-4007-a13a-84db692ed5ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c", "tag": "c1887889-94c0-435d-9dc4-a46cb2e8dbac"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:13.712529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-02599ffa-fde3-4d65-b179-1df82f0a7eac req-24cd4179-1dc1-4007-a13a-84db692ed5ef service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.713792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-02599ffa-fde3-4d65-b179-1df82f0a7eac req-24cd4179-1dc1-4007-a13a-84db692ed5ef service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.803557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-02599ffa-fde3-4d65-b179-1df82f0a7eac req-24cd4179-1dc1-4007-a13a-84db692ed5ef service nova] Creating event network-changed:c1887889-94c0-435d-9dc4-a46cb2e8dbac for instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c on hv-cinder-82660 Jun 23 11:55:13.813024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-02599ffa-fde3-4d65-b179-1df82f0a7eac req-24cd4179-1dc1-4007-a13a-84db692ed5ef service nova] Acquired lock "compute-rpcapi-router" {{(pid=117746) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 11:55:13.814609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aef69e17-d390-4029-89a0-fdebabc901bd None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.816933 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aef69e17-d390-4029-89a0-fdebabc901bd None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.820956 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aef69e17-d390-4029-89a0-fdebabc901bd None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.823237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aef69e17-d390-4029-89a0-fdebabc901bd None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.854694 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.compute.rpcapi [None req-aef69e17-d390-4029-89a0-fdebabc901bd None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 11:55:13.855635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aef69e17-d390-4029-89a0-fdebabc901bd None None] Releasing lock "compute-rpcapi-router" {{(pid=117746) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 11:55:13.914476 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-aef69e17-d390-4029-89a0-fdebabc901bd None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.503098 Jun 23 11:55:13.915327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 14/28] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 505 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:13.925024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:13.927413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:13.962514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.964215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:13.964874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:13.965325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:14.587195 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:14.604643 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c8d08005-fe5f-4458-9dab-8dca3c766ee4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 1.247828 Jun 23 11:55:14.609880 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 15/29] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:13 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 1254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:15.509317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:15.526244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d025f23e-6ba9-4d0d-9e7f-24e41439d4cc tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 1.608798 Jun 23 11:55:15.527583 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 15/30] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:13 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 1612 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:15.627156 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:15.627971 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:15.654869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:15.655838 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:15.657924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:15.660114 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.545906 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:16.547076 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:16.564058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.568002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.569006 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.570002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.859179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:16.874242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a296dc1a-36e3-4fd6-971a-ffbdbed2dafe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 1.249921 Jun 23 11:55:16.883587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 16/31] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:15 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 1261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:16.889447 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-93980c38-1db6-4854-ba0b-7c775088050d req-7d7efca1-42c6-4497-83eb-633a7acff6ff service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e63e29e5-ecda-4f38-a06f-ba4d2cf35e50", "tag": "66465037-49ad-4b75-9a72-74ba5935f37a"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:16.911248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-93980c38-1db6-4854-ba0b-7c775088050d req-7d7efca1-42c6-4497-83eb-633a7acff6ff service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.912303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-93980c38-1db6-4854-ba0b-7c775088050d req-7d7efca1-42c6-4497-83eb-633a7acff6ff service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.952305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-93980c38-1db6-4854-ba0b-7c775088050d req-7d7efca1-42c6-4497-83eb-633a7acff6ff service nova] Creating event network-changed:66465037-49ad-4b75-9a72-74ba5935f37a for instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 on hv-cinder-82660 Jun 23 11:55:16.954055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-93980c38-1db6-4854-ba0b-7c775088050d req-7d7efca1-42c6-4497-83eb-633a7acff6ff service nova] Acquired lock "compute-rpcapi-router" {{(pid=117747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 23 11:55:16.956301 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-15807a98-376e-4067-ba49-455b269a8555 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.957167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-15807a98-376e-4067-ba49-455b269a8555 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.958729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-15807a98-376e-4067-ba49-455b269a8555 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:16.959366 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-15807a98-376e-4067-ba49-455b269a8555 None None] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:16.970353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.compute.rpcapi [None req-15807a98-376e-4067-ba49-455b269a8555 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 23 11:55:16.971675 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-15807a98-376e-4067-ba49-455b269a8555 None None] Releasing lock "compute-rpcapi-router" {{(pid=117747) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 23 11:55:16.997411 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-15807a98-376e-4067-ba49-455b269a8555 None None] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.111103 Jun 23 11:55:16.999498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 17/32] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:16 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:17.557677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:17.570146 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8adb653d-e838-4f80-b219-774bd1339d59 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 1.026920 Jun 23 11:55:17.580935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 16/33] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:16 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 1040 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:17.800432 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-398210195", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2860678-188a-43de-956c-7f6a2a5353f6"}], "security_groups": [{"name": "tempest-securitygroup--2004205864"}], "key_name": "tempest-keypair-1722598700", "user_data": "}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:17.899605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:17.901559 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:17.912692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:17.913419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:17.914418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:17.914999 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:18.193200 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] validate_networks() for [('e2860678-188a-43de-956c-7f6a2a5353f6', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:55:18.499148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:18.511595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cec2f3c8-8308-428d-a953-758a7b7adbe4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.616781 Jun 23 11:55:18.514537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 17/34] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:17 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 620 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:18.528905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1196667449", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95d2a966-c2d0-4baf-b3af-40bcab8446e6"}], "security_groups": [{"name": "tempest-securitygroup--1204417498"}], "key_name": "tempest-keypair-11104482", "user_data": "}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:19.099016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] validate_networks() for [('95d2a966-c2d0-4baf-b3af-40bcab8446e6', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:55:19.772324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:55:19.772854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:55:19.773238 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:55:19.773642 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:55:19.774442 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:55:19.787468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:19.789049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:19.790092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:19.790529 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:19.812816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:55:19.817681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:55:19.835016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:55:19.840778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:55:19.925402 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6572c303-af08-4a67-9068-5bc2935cb6fc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.130120 Jun 23 11:55:19.933525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 18/35] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:55:17 2022] POST /compute/v2.1/servers => generated 402 bytes in 2140 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:55:19.941585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-115636511", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ec90cf8-67c4-41e3-bbbb-0e606173a369"}], "security_groups": [{"name": "tempest-securitygroup--810363084"}], "key_name": "tempest-keypair-238375666", "user_data": "}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:20.246187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] validate_networks() for [('6ec90cf8-67c4-41e3-bbbb-0e606173a369', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:55:20.386547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:55:20.387000 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:55:20.387373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:55:20.387805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:55:20.388174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:55:20.423819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:20.429514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:20.431383 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:20.432150 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:20.457157 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for project d211354c655b469491d235e5507e61ba. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:55:20.462633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for user ebfb5a6c657a4fd592ff9e67348627eb and project d211354c655b469491d235e5507e61ba. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:55:20.480382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:55:20.483112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:55:20.567686 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-67d875fe-25a8-499c-909f-658fffff9f46 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.049511 Jun 23 11:55:20.573974 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 18/36] 10.222.0.67 () {62 vars in 1187 bytes} [Thu Jun 23 11:55:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 2058 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 11:55:20.585113 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:20.586110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:20.612741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:20.613500 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:20.614515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:20.616991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:20.673031 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=86,nova_api:INSERT=11 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:20.799449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:20.812453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6f1f534d-c9c5-41c3-8d0e-d03279b1737f tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 0.234230 Jun 23 11:55:20.813595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 19/37] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:20 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:21.102347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:55:21.103525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:55:21.104239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:55:21.104941 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:55:21.105696 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:55:21.123441 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.123952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.125142 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.126380 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.141506 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=65 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:21.167060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:55:21.176554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for user 9ab84989dd384d15b316b20cc65e792a and project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:55:21.190688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:55:21.193428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:55:21.200428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-80efe563-a3e8-4ef2-afcc-5969809fea1f req-7e0599b7-a2bb-490a-a108-8366ebd0d2aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec85106b-8a3d-4c85-b842-40523a7eb9ca", "tag": "9ebd518b-a0cf-45b8-bc44-758c460d139b"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:21.211534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-80efe563-a3e8-4ef2-afcc-5969809fea1f req-7e0599b7-a2bb-490a-a108-8366ebd0d2aa service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.212321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-80efe563-a3e8-4ef2-afcc-5969809fea1f req-7e0599b7-a2bb-490a-a108-8366ebd0d2aa service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.248164 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-80efe563-a3e8-4ef2-afcc-5969809fea1f req-7e0599b7-a2bb-490a-a108-8366ebd0d2aa service nova] Creating event network-changed:9ebd518b-a0cf-45b8-bc44-758c460d139b for instance ec85106b-8a3d-4c85-b842-40523a7eb9ca on hv-cinder-82660 Jun 23 11:55:21.269469 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-80efe563-a3e8-4ef2-afcc-5969809fea1f req-7e0599b7-a2bb-490a-a108-8366ebd0d2aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.453219 Jun 23 11:55:21.272976 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 20/38] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:21.285732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:21.287827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:21.303004 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.306009 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.307013 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.308418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.317855 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-58012866-f0bb-4f10-97a0-58f57404542a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.382749 Jun 23 11:55:21.321091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 19/39] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:55:19 2022] POST /compute/v2.1/servers => generated 401 bytes in 1387 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:55:21.330656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:21.336221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:21.349614 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.353918 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.356273 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.357167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.472508 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.489562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9b02720c-47bf-452a-b0e4-d6526464892b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1245 microversion: 2.1 time: 0.166332 Jun 23 11:55:21.494006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 20/40] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:21 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1245 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:21.500105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:21.504337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:21.520181 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.521385 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.523474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.523943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.619290 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.631458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-83f004d4-200e-47d6-888a-b3bdb18a3a7f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.355489 Jun 23 11:55:21.634054 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 21/41] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:21 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:21.644607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-878f1ccb-a61d-489c-8e70-6faea1055f03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:21.645279 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-878f1ccb-a61d-489c-8e70-6faea1055f03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:21.655769 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.672821 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.677676 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.679540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8d529073-bdbb-47d6-9bf5-873932f6e1ca tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1284 microversion: 2.20 time: 0.183882 Jun 23 11:55:21.680068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 21/42] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:21 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1284 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:21.724855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-878f1ccb-a61d-489c-8e70-6faea1055f03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:21.732297 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-878f1ccb-a61d-489c-8e70-6faea1055f03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1236 microversion: 2.1 time: 0.097059 Jun 23 11:55:21.733187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 22/43] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:21 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1236 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:21.832257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:21.833259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:21.842115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.842799 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:21.843855 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:21.844382 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.109306 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.125424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7627564e-a026-4f85-9630-f7275e6e2729 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 0.297758 Jun 23 11:55:22.131246 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 22/44] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:21 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:22.514314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:22.515062 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:22.525858 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.529518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.530523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.532744 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.656269 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:22.658071 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:22.666269 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.675942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.678322 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.681598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.684839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.699150 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cbee46d0-8381-4589-9f89-87aaee47361e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1293 microversion: 2.1 time: 0.187303 Jun 23 11:55:22.703633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 23/45] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:22 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1293 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:22.713669 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:22.714397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:22.721896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.722357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.723156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.723600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.814552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.842673 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.844389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:22.845807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fb470314-c17a-42ae-bc44-ee23e5ea4faf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1332 microversion: 2.20 time: 0.140975 Jun 23 11:55:22.846534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 24/46] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:22 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1332 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:22.874318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:22.874943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:22.889934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.890699 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:22.898631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:22.899350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:23.011991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:23.012146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:23.026896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5532c455-6e7e-4832-b799-01d0eb6242b5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.375707 Jun 23 11:55:23.027636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-46a94f50-3873-46f1-9e0b-542de8837271 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1288 microversion: 2.1 time: 0.165651 Jun 23 11:55:23.028283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 25/47] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:22 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1288 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:23.050213 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 23/48] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:22 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 400 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:23.147863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:23.149282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:23.168978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:23.173722 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:23.174908 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:23.180344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:23.441511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:23.467474 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c7fab058-e2e3-411f-aea4-d941a4a16f3d tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 0.323437 Jun 23 11:55:23.470487 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 26/49] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:23 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:23.724053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:23.726260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:23.745322 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:23.746196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:23.747178 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:23.749762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.145378 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:24.154619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4392fbaa-6617-459d-b444-f0c109a74953 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1311 microversion: 2.1 time: 0.439557 Jun 23 11:55:24.159834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 24/50] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:23 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1311 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:24.172380 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:24.173116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:24.188504 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.190823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.191637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.196997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.268835 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-7802b416-61b7-458a-9960-fe1288b0de2e req-682ee7b4-45e4-4a85-83c7-886624e26b1a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c", "name": "network-vif-plugged", "status": "completed", "tag": "c1887889-94c0-435d-9dc4-a46cb2e8dbac"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:24.289142 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7802b416-61b7-458a-9960-fe1288b0de2e req-682ee7b4-45e4-4a85-83c7-886624e26b1a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.289585 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7802b416-61b7-458a-9960-fe1288b0de2e req-682ee7b4-45e4-4a85-83c7-886624e26b1a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.302108 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-7802b416-61b7-458a-9960-fe1288b0de2e req-682ee7b4-45e4-4a85-83c7-886624e26b1a service nova] Creating event network-vif-plugged:c1887889-94c0-435d-9dc4-a46cb2e8dbac for instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c on hv-cinder-82660 Jun 23 11:55:24.307821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-7802b416-61b7-458a-9960-fe1288b0de2e req-682ee7b4-45e4-4a85-83c7-886624e26b1a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.465856 Jun 23 11:55:24.313025 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 27/51] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:24.320359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:24.321659 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:24.325263 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:24.325425 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:24.329592 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.330276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.331272 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.331882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.336904 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:24.339672 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:24.341548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d5f094f1-b084-4da2-84b5-c85ceb68a81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1338 microversion: 2.20 time: 0.180707 Jun 23 11:55:24.345588 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 25/52] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:24 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1338 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:24.371839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:24.372413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:24.395029 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.396813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.398228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.398671 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.633402 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:24.644642 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4d0b1c80-537d-42e0-93ec-8ead84bfaf41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1294 microversion: 2.1 time: 0.330016 Jun 23 11:55:24.645264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 28/53] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:24 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1294 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:24.674197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:24.674817 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:24.685871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.686628 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.689835 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:24.690493 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:24.749012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=97 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:25.304169 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:25.312908 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3cd2c691-218d-4576-8266-fe734e7eb614 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.964237 Jun 23 11:55:25.313880 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 26/54] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:24 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 967 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:25.343548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:25.346201 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:25.348020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:25.358028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3f80b01f-b122-44c2-9501-364514d1f9e9 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 0.711649 Jun 23 11:55:25.361757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 29/55] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:24 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:25.367107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.367899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.368058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:25.369113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.369771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.369893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:25.391176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.394167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.395342 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.395995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.605148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:25.619453 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a9f2a5c7-71ca-4226-bcd4-dbe2389c5085 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1299 microversion: 2.1 time: 0.281382 Jun 23 11:55:25.620106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 27/56] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:25 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1299 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:25.669761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:25.670978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:25.691425 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.693765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.698500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:25.700924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:25.836874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:25.853407 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:25.859961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:25.864516 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ce911d38-9ed1-49bc-9367-14ba9bf79526 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.501819 Jun 23 11:55:25.865999 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 30/57] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:25 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:25.934190 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:25.954727 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-88365cb9-31ae-4b59-b678-1355dabba434 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1294 microversion: 2.1 time: 0.293649 Jun 23 11:55:25.958552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 28/58] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:25 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1294 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:26.329900 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:26.331255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-22b44fb5-639f-4172-9313-98045382c54d req-bfa7e006-6425-4376-839a-59042cf9bf37 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e29e5-ecda-4f38-a06f-ba4d2cf35e50", "name": "network-vif-plugged", "status": "completed", "tag": "66465037-49ad-4b75-9a72-74ba5935f37a"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:26.332102 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:26.352912 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.353364 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.354150 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.362181 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-22b44fb5-639f-4172-9313-98045382c54d req-bfa7e006-6425-4376-839a-59042cf9bf37 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.363850 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.367085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-22b44fb5-639f-4172-9313-98045382c54d req-bfa7e006-6425-4376-839a-59042cf9bf37 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.424940 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-22b44fb5-639f-4172-9313-98045382c54d req-bfa7e006-6425-4376-839a-59042cf9bf37 service nova] Creating event network-vif-plugged:66465037-49ad-4b75-9a72-74ba5935f37a for instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 on hv-cinder-82660 Jun 23 11:55:26.440501 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-22b44fb5-639f-4172-9313-98045382c54d req-bfa7e006-6425-4376-839a-59042cf9bf37 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.116519 Jun 23 11:55:26.441992 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 31/59] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:26.460098 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:26.466643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:26.494896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.498640 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.499529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.500293 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.904150 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:26.917508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-640fe63c-9eab-4df0-9060-7aeec6b11737 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1314 microversion: 2.1 time: 0.472758 Jun 23 11:55:26.929156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 32/60] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:26 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1314 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:26.935644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:26.936213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:26.949275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.949705 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:26.952231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:26.953591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.279497 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.294173 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f29af220-5ddc-41e0-981e-b4e4e2519237 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.968213 Jun 23 11:55:27.304449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 29/61] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:26 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 979 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:27.313894 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:27.314518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:27.332296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.332990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.333770 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.334231 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.471462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.482368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-907c987d-518c-4dc3-bacc-2e4dcc23bb01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.549206 Jun 23 11:55:27.482368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 33/62] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:26 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 551 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:27.485340 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:27.485952 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:27.492868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.493309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.494115 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.494501 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.704821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.719689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b69c4f76-5d9a-47b7-99bf-10526d2398fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.238264 Jun 23 11:55:27.721928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 34/63] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:27 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:27.728776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-769d2a79-c71c-4f62-8aa6-b6b6d7c18abc req-e22023d0-baa8-4f3d-945f-9d7f5db5876b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ec4d3-4ce1-4fbd-81ea-025a5c724421", "tag": "8e9b4dc6-7a9c-4183-b1a8-10297c792e0e"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:27.739466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-769d2a79-c71c-4f62-8aa6-b6b6d7c18abc req-e22023d0-baa8-4f3d-945f-9d7f5db5876b service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.740161 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-769d2a79-c71c-4f62-8aa6-b6b6d7c18abc req-e22023d0-baa8-4f3d-945f-9d7f5db5876b service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.757441 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-769d2a79-c71c-4f62-8aa6-b6b6d7c18abc req-e22023d0-baa8-4f3d-945f-9d7f5db5876b service nova] Creating event network-changed:8e9b4dc6-7a9c-4183-b1a8-10297c792e0e for instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 on hv-cinder-82660 Jun 23 11:55:27.762398 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-769d2a79-c71c-4f62-8aa6-b6b6d7c18abc req-e22023d0-baa8-4f3d-945f-9d7f5db5876b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039131 Jun 23 11:55:27.763041 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 35/64] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:27.910698 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.925410 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.927212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:27.928578 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2ab28d5f-6be8-4a66-a6d6-9226c9d9b5e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.623302 Jun 23 11:55:27.946385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:27.947252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:27.953320 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 30/65] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:27 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 648 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:27.956128 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.956748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:27.957637 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:27.958188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.311264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:28.311539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:28.312242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:28.322385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9c9f0418-d923-4304-851f-32547653a4ff tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1501 microversion: 2.1 time: 0.380499 Jun 23 11:55:28.322660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.323319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.323452 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 36/66] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:27 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1501 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:28.337191 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.337757 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.471052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-49e65f76-b642-4318-a369-8d1d6ed7c7cc req-a370225e-71ee-4a85-8afa-e6931b801888 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec85106b-8a3d-4c85-b842-40523a7eb9ca", "name": "network-vif-plugged", "status": "completed", "tag": "9ebd518b-a0cf-45b8-bc44-758c460d139b"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:28.488496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-49e65f76-b642-4318-a369-8d1d6ed7c7cc req-a370225e-71ee-4a85-8afa-e6931b801888 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.489757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-49e65f76-b642-4318-a369-8d1d6ed7c7cc req-a370225e-71ee-4a85-8afa-e6931b801888 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.523603 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-49e65f76-b642-4318-a369-8d1d6ed7c7cc req-a370225e-71ee-4a85-8afa-e6931b801888 service nova] Creating event network-vif-plugged:9ebd518b-a0cf-45b8-bc44-758c460d139b for instance ec85106b-8a3d-4c85-b842-40523a7eb9ca on hv-cinder-82660 Jun 23 11:55:28.548651 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-49e65f76-b642-4318-a369-8d1d6ed7c7cc req-a370225e-71ee-4a85-8afa-e6931b801888 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.091653 Jun 23 11:55:28.550808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 37/67] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:28.570054 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:28.573745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:28.591227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.592084 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.609871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.610337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.902869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:28.911484 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-825f92c7-56c7-41a0-ac0f-93112d7433cf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.358477 Jun 23 11:55:28.917777 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:28.949989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 38/68] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:28 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:28.962442 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3d709eef-a69b-4105-887e-4a3664a88f57 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.653313 Jun 23 11:55:28.965864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 31/69] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:28 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 659 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:28.971011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:28.971630 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:28.976854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:28.977457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:28.986639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.987796 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.992651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.993955 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:28.994423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.998734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:28.999566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.001303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.306462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:29.318806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cbf7e7f9-5d53-4e04-9d02-511c27d905fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.366094 Jun 23 11:55:29.321266 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 39/70] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:28 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:29.438912 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:29.455674 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:29.457965 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:29.460532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-dfbfd670-594d-412f-9948-fb2dfabb535d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.489432 Jun 23 11:55:29.491997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 32/71] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:28 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:29.522551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-59f2f6d1-f993-4069-9b49-08c264d7f259 req-c1bfa46b-5299-46b5-ab48-c6a1219005a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67c82c1-7c40-43a6-9326-480dc5fcb37a", "tag": "aa6285e7-0658-4131-aef9-e0151dcf7912"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:29.546312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-59f2f6d1-f993-4069-9b49-08c264d7f259 req-c1bfa46b-5299-46b5-ab48-c6a1219005a1 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.566703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-59f2f6d1-f993-4069-9b49-08c264d7f259 req-c1bfa46b-5299-46b5-ab48-c6a1219005a1 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.590975 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-59f2f6d1-f993-4069-9b49-08c264d7f259 req-c1bfa46b-5299-46b5-ab48-c6a1219005a1 service nova] Creating event network-changed:aa6285e7-0658-4131-aef9-e0151dcf7912 for instance d67c82c1-7c40-43a6-9326-480dc5fcb37a on hv-cinder-82660 Jun 23 11:55:29.633807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-59f2f6d1-f993-4069-9b49-08c264d7f259 req-c1bfa46b-5299-46b5-ab48-c6a1219005a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.115536 Jun 23 11:55:29.638052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 40/72] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:29.941146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:29.941946 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:29.958216 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.958864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.960339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:29.962625 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:29.986101 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:29.987154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:30.012455 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.012966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.013798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.014237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.327487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:30.336248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-626d9809-f2b2-40e5-aebf-f7c23d1e6667 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.400431 Jun 23 11:55:30.351542 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 33/73] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:29 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:30.357629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-447e5869-05e9-45de-8b38-f4357562ff27 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7b021d35-ac28-4751-851e-f40766f2a560"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:30.358981 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-447e5869-05e9-45de-8b38-f4357562ff27 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:30.366928 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-447e5869-05e9-45de-8b38-f4357562ff27 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.367539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-447e5869-05e9-45de-8b38-f4357562ff27 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.368466 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-447e5869-05e9-45de-8b38-f4357562ff27 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.369088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-447e5869-05e9-45de-8b38-f4357562ff27 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.394859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:30.404486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-89c5990f-c910-4d70-babc-4d9a75181725 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.425194 Jun 23 11:55:30.417225 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 41/74] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:29 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:30.426490 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:30.427281 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:30.434973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.435426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.436205 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.436883 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.482053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=4 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:30.755500 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:30.765082 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ff725e19-da05-4899-bcf7-83154daa5dcb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.346399 Jun 23 11:55:30.765944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 42/75] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:30 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:30.796820 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:30.797421 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:30.807936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.808404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.809485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:30.809940 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:30.871890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-447e5869-05e9-45de-8b38-f4357562ff27 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "POST /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.518137 Jun 23 11:55:30.873326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 34/76] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:55:30 2022] POST /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c/os-volume_attachments => generated 194 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:31.112181 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:31.123639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:31.125463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:31.126981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fb231cc3-dbbb-4f97-b5e2-988b32e7a61f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.359724 Jun 23 11:55:31.127580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 43/77] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:30 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 361 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:31.358563 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:31.359574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:31.363620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=6 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:31.364655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=12 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:31.374091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.374789 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.375677 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.376205 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.383306 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:31.421343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:31.421953 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:31.429039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.430227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.431179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.431884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.730350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=8 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:31.735850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:31.776386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9d1c2c86-b8e0-4f29-aef9-22f8f0e58847 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1321 microversion: 2.1 time: 0.357920 Jun 23 11:55:31.787791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 44/78] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:31 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1321 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:31.795926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-760f46e1-2735-4f80-a42a-4cab897642a9 req-7dd97e44-2516-40ef-bfc7-69ebaed1fb26 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7134bd36-8b37-48ff-bcfb-ab369c0ef601", "tag": "2b1b9605-d448-4f5e-8b07-f5d1a8bf6799"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:31.830212 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-760f46e1-2735-4f80-a42a-4cab897642a9 req-7dd97e44-2516-40ef-bfc7-69ebaed1fb26 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.831139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-760f46e1-2735-4f80-a42a-4cab897642a9 req-7dd97e44-2516-40ef-bfc7-69ebaed1fb26 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.842730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:31.860762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-132dbd4d-9d4b-4ce0-9c18-d9c4e8327306 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.506120 Jun 23 11:55:31.861374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 35/79] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:31 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 508 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:31.870028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-760f46e1-2735-4f80-a42a-4cab897642a9 req-7dd97e44-2516-40ef-bfc7-69ebaed1fb26 service nova] Creating event network-changed:2b1b9605-d448-4f5e-8b07-f5d1a8bf6799 for instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 on hv-cinder-82660 Jun 23 11:55:31.882859 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:31.883610 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:31.888413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-760f46e1-2735-4f80-a42a-4cab897642a9 req-7dd97e44-2516-40ef-bfc7-69ebaed1fb26 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098448 Jun 23 11:55:31.891954 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 45/80] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:31.893262 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.893915 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:31.894702 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:31.895135 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.148032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:32.149093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:32.156237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.157058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.158181 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.158809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.224418 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:32.235570 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1fcd665f-4b20-467e-8501-16f92a6de2c9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.373110 Jun 23 11:55:32.245634 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 36/81] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:31 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:32.335106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:32.345448 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:32.347360 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:32.348880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4af9094b-f437-4792-ad2a-26b0150ecc56 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.206152 Jun 23 11:55:32.349542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 46/82] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:32 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:32.807771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:32.812512 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:32.845337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.853215 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.856083 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.857875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.882275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:32.889194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:32.928426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.929270 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:32.930673 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:32.931413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:33.409920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:33.420911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-97a66428-b884-465f-b01d-3e021197aa0d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.545943 Jun 23 11:55:33.425738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 47/83] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:32 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 552 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:33.440011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:33.443822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:33.462226 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:33.463191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:33.474222 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:33.476452 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:33.491478 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:33.501643 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a68466ee-ca52-4590-bded-0a8d5c26e6fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1515 microversion: 2.1 time: 0.706804 Jun 23 11:55:33.507201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 37/84] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:32 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1515 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:33.517362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:33.520374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:33.534489 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:33.535267 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:33.536263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:33.538791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:33.880883 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:33.889446 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a96844d3-9157-4ac5-9a6d-7df486ea6c0d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.462282 Jun 23 11:55:33.893511 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:33.897715 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 48/85] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:33 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 471 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:33.905658 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:33.907515 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:33.912054 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f0521a6d-ab55-45f6-8caa-46711e24c6e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.403497 Jun 23 11:55:33.913591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 38/86] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:33 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:33.919890 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:33.932873 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:33.941159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:33.941619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:33.944976 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:33.944976 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:33.946070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:34.014930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lazy-loading 'flavor' on Instance uuid ec85106b-8a3d-4c85-b842-40523a7eb9ca {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:55:34.146745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2ae06529-1694-4989-8fb4-79067d0768be tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca/action" status: 200 len: 32 microversion: 2.1 time: 0.243592 Jun 23 11:55:34.148018 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 49/87] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:55:33 2022] POST /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca/action => generated 32 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 11:55:34.158159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:34.158801 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:34.166528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.167157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:34.168644 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.169535 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:34.331704 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:34.341431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-da60e5a1-ed03-495f-ae90-4be292a57892 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.188483 Jun 23 11:55:34.341997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 39/88] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:34 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:34.441761 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:34.442453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:34.450527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.450982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:34.451931 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.452520 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:34.604113 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:34.613263 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8408a088-786a-4498-ab1b-7a4797050e18 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.175579 Jun 23 11:55:34.614060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 50/89] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:34 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:34.908280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:34.909738 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:34.920628 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.923158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:34.926180 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.929689 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:34.937705 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:34.944633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:34.970207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.973376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:34.974232 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:34.977820 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.258905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:35.267049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-63f32b3e-29ed-4b05-b5af-73e0abfd7b14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.363506 Jun 23 11:55:35.271900 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 40/90] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:34 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:35.277063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-a688a68e-d201-414c-a6f4-f27b1fb99284 req-5097d317-fdaa-4e8b-a3f7-cf3eeb2b8b4f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ec4d3-4ce1-4fbd-81ea-025a5c724421", "name": "network-vif-plugged", "status": "completed", "tag": "8e9b4dc6-7a9c-4183-b1a8-10297c792e0e"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:35.319958 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-a688a68e-d201-414c-a6f4-f27b1fb99284 req-5097d317-fdaa-4e8b-a3f7-cf3eeb2b8b4f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.320403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-a688a68e-d201-414c-a6f4-f27b1fb99284 req-5097d317-fdaa-4e8b-a3f7-cf3eeb2b8b4f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.344219 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-a688a68e-d201-414c-a6f4-f27b1fb99284 req-5097d317-fdaa-4e8b-a3f7-cf3eeb2b8b4f service nova] Creating event network-vif-plugged:8e9b4dc6-7a9c-4183-b1a8-10297c792e0e for instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 on hv-cinder-82660 Jun 23 11:55:35.355568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-a688a68e-d201-414c-a6f4-f27b1fb99284 req-5097d317-fdaa-4e8b-a3f7-cf3eeb2b8b4f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.080173 Jun 23 11:55:35.364166 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 41/91] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:35.371350 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:35.372358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:35.379197 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.379938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.380945 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.381608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.627720 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:35.640552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:35.642595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:35.643346 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d40e3026-737b-4a50-a9a6-876dd4cedfb4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.715709 Jun 23 11:55:35.644126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 51/92] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:34 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 717 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:35.659856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1756660413", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "networks": [{"uuid": "1cbb7bc8-91c5-4257-ad30-f56ed02325b3"}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:35.721514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] validate_networks() for [('1cbb7bc8-91c5-4257-ad30-f56ed02325b3', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:55:35.773765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:35.790537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-50cc9b99-6fa6-415e-916d-3a26d9df25aa tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.423318 Jun 23 11:55:35.791863 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 42/93] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:35 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:35.811589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:35.812411 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:35.828251 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.829021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:35.835994 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:35.836620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.095005 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:36.103535 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-196e1bc1-f53c-4b8d-b465-42bc84e70946 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.304804 Jun 23 11:55:36.104135 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 43/94] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:35 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:36.189608 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:55:36.190752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:55:36.190752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:55:36.191291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:55:36.191940 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:55:36.205938 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.206616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.207864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.208971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.239652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Getting quotas for project a5a0086895b6442da90bc0f1bcecd3e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:55:36.245066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Getting quotas for user f7cf8ed5de4b41b19b6f25299087e1b5 and project a5a0086895b6442da90bc0f1bcecd3e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:55:36.262784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:55:36.266760 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:55:36.291814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.291814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.305307 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.306129 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.307525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.308194 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.347951 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3a7f2c62-8c0c-4eb8-91a6-93b05e2e5f3d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.693281 Jun 23 11:55:36.349521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 52/95] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:55:35 2022] POST /compute/v2.1/servers => generated 380 bytes in 705 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:55:36.359247 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7de12277-5d7d-4e1c-a371-bea42a9641e9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.361165 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7de12277-5d7d-4e1c-a371-bea42a9641e9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.441428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7de12277-5d7d-4e1c-a371-bea42a9641e9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:36.450186 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7de12277-5d7d-4e1c-a371-bea42a9641e9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1219 microversion: 2.1 time: 0.095246 Jun 23 11:55:36.453023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 53/96] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:36 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1219 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:36.515195 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:36.524264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-38d4798d-28f3-47d4-93d5-34d6b9b4098e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.240024 Jun 23 11:55:36.524942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 44/97] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:36 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:36.671583 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.673309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.683369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.684103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.685841 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.686744 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.808838 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:36.809455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:36.816379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.816943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.817827 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:36.818330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:36.888930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:36.898523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:36.901254 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:36.902486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-37774dcb-34b5-467f-8799-bae972d63f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1406 microversion: 2.20 time: 0.241330 Jun 23 11:55:36.903917 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 54/98] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:36 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1406 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:36.983609 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:36.991839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b74164cb-db46-4fb9-b981-198eaeb410a8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.187032 Jun 23 11:55:36.997151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 45/99] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:36 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:37.120533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.121172 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.127853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.128504 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.129614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.130205 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.270637 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:37.278251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0adfd754-91ca-4306-95a8-c333a190a09b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.161559 Jun 23 11:55:37.278820 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 55/100] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:37 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:37.406916 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-311938c9-867f-4e09-acb5-0fb4c654c41b req-23062bb8-7e7d-4948-acca-2e7df6476e8e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7134bd36-8b37-48ff-bcfb-ab369c0ef601", "name": "network-vif-plugged", "status": "completed", "tag": "2b1b9605-d448-4f5e-8b07-f5d1a8bf6799"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:37.419363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-311938c9-867f-4e09-acb5-0fb4c654c41b req-23062bb8-7e7d-4948-acca-2e7df6476e8e service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.419860 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-311938c9-867f-4e09-acb5-0fb4c654c41b req-23062bb8-7e7d-4948-acca-2e7df6476e8e service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.437539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-311938c9-867f-4e09-acb5-0fb4c654c41b req-23062bb8-7e7d-4948-acca-2e7df6476e8e service nova] Creating event network-vif-plugged:2b1b9605-d448-4f5e-8b07-f5d1a8bf6799 for instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 on hv-cinder-82660 Jun 23 11:55:37.445753 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-311938c9-867f-4e09-acb5-0fb4c654c41b req-23062bb8-7e7d-4948-acca-2e7df6476e8e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042651 Jun 23 11:55:37.447113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 46/101] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:37.468307 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.468989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.477277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.478343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.479911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.481045 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.542564 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.543628 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.553128 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.554131 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.557033 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.557522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.557778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:37.565501 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6d6316b4-5e90-4371-9ffa-174c8882dcec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1271 microversion: 2.1 time: 0.101779 Jun 23 11:55:37.569027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 56/102] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:37 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1271 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:37.708630 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:37.716203 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e44b3d60-e9a5-4b27-aa01-8a92d59e1478 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.178893 Jun 23 11:55:37.716796 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 47/103] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:37 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:37.920599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:37.921284 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:37.927402 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.927849 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:37.929198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:37.929636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.008645 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:38.009363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:38.015759 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.016427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.017244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.017683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.073511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:38.082797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:38.084574 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:38.086649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fa1c0ce2-47bb-4780-b6c4-652ff11cb8b4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1598 microversion: 2.20 time: 0.170227 Jun 23 11:55:38.087505 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 57/104] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:55:37 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1598 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:55:38.107018 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-968bb4ee-d0e4-4aae-a4ca-c69c53948b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:38.107757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-968bb4ee-d0e4-4aae-a4ca-c69c53948b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:38.114373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-968bb4ee-d0e4-4aae-a4ca-c69c53948b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.115002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-968bb4ee-d0e4-4aae-a4ca-c69c53948b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.122635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-968bb4ee-d0e4-4aae-a4ca-c69c53948b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.123240 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-968bb4ee-d0e4-4aae-a4ca-c69c53948b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.203692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-968bb4ee-d0e4-4aae-a4ca-c69c53948b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.100645 Jun 23 11:55:38.204327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 58/105] 10.222.0.67 () {60 vars in 1315 bytes} [Thu Jun 23 11:55:38 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:55:38.297075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:38.297845 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:38.304614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.305249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.306271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.306815 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.475553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:38.485546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7faeab41-db78-44be-b990-4cc40a7cb390 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.480762 Jun 23 11:55:38.486309 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 48/106] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:38 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:38.575127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:38.583087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ea49b54e-5eaa-4b00-9cb4-9366e2391fe7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.291421 Jun 23 11:55:38.583961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 59/107] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:38 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:38.586189 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:38.586813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:38.593176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.593630 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.594404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.594845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.667797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:38.677959 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cd2c1fcf-10dc-4b1d-82d7-f3ef5dda181c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1289 microversion: 2.1 time: 0.098038 Jun 23 11:55:38.679543 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 49/108] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:38 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1289 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:38.734765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:38.735641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:38.743714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.744433 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:38.745681 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:38.746314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.073324 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:39.086143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-75c01f79-9ce2-4de8-9f60-4551b2c13584 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.355303 Jun 23 11:55:39.087214 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 60/109] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:38 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:39.463571 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-8f6dd287-0780-4db5-832f-c7255b53c9b4 req-c9146dff-feb1-4800-b5ab-0b30a1fce426 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67c82c1-7c40-43a6-9326-480dc5fcb37a", "name": "network-vif-plugged", "status": "completed", "tag": "aa6285e7-0658-4131-aef9-e0151dcf7912"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:39.474277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-8f6dd287-0780-4db5-832f-c7255b53c9b4 req-c9146dff-feb1-4800-b5ab-0b30a1fce426 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:39.474988 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-8f6dd287-0780-4db5-832f-c7255b53c9b4 req-c9146dff-feb1-4800-b5ab-0b30a1fce426 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.489268 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-8f6dd287-0780-4db5-832f-c7255b53c9b4 req-c9146dff-feb1-4800-b5ab-0b30a1fce426 service nova] Creating event network-vif-plugged:aa6285e7-0658-4131-aef9-e0151dcf7912 for instance d67c82c1-7c40-43a6-9326-480dc5fcb37a on hv-cinder-82660 Jun 23 11:55:39.496512 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-8f6dd287-0780-4db5-832f-c7255b53c9b4 req-c9146dff-feb1-4800-b5ab-0b30a1fce426 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038572 Jun 23 11:55:39.503047 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:39.504394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:39.508337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 50/110] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:39.513306 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:39.514000 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.514974 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:39.515689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.602823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:39.604210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:39.615252 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:39.617343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.620015 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:39.623627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.848468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:39.862324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:39.865720 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ecb233ff-95a6-4a3d-baa3-dd720c6398f2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.366933 Jun 23 11:55:39.867259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 61/111] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:39 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 369 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:39.875826 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:39.876769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:39.885016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:39.885748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.887639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:39.888318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:39.890362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7627ea6b-cf04-4682-882f-ce8d63dfcb7d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.293212 Jun 23 11:55:39.895034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 51/112] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:39 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:40.008164 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:40.018019 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-896bb1a6-d8d2-41ad-9275-8b5daf8d8eec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1277 microversion: 2.1 time: 0.149634 Jun 23 11:55:40.018607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 62/113] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:39 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1277 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:40.105239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:40.105776 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:40.113468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:40.114178 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:40.115095 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:40.115674 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:40.404507 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:40.416416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3a31c702-788e-488c-9d4c-83b3fcf282d1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.313024 Jun 23 11:55:40.417397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 52/114] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:40 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:40.426864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-45431c4a-a721-4571-bf5d-4fdd43f98da6 req-dfc0dce3-87c9-465c-9abf-aedad275cf2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e19ec4d3-4ce1-4fbd-81ea-025a5c724421", "tag": "8e9b4dc6-7a9c-4183-b1a8-10297c792e0e"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:40.473990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-45431c4a-a721-4571-bf5d-4fdd43f98da6 req-dfc0dce3-87c9-465c-9abf-aedad275cf2e service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:40.476559 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-45431c4a-a721-4571-bf5d-4fdd43f98da6 req-dfc0dce3-87c9-465c-9abf-aedad275cf2e service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:40.499084 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-45431c4a-a721-4571-bf5d-4fdd43f98da6 req-dfc0dce3-87c9-465c-9abf-aedad275cf2e service nova] Creating event network-changed:8e9b4dc6-7a9c-4183-b1a8-10297c792e0e for instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 on hv-cinder-82660 Jun 23 11:55:40.504696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-45431c4a-a721-4571-bf5d-4fdd43f98da6 req-dfc0dce3-87c9-465c-9abf-aedad275cf2e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.082217 Jun 23 11:55:40.507209 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 63/115] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:40.886974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:40.889263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:40.889750 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:40.890713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:40.898753 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:40.899504 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:40.900455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:40.901116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:40.905844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:40.909827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:40.910740 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:40.911171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:40.974201 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:55:41.131216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:41.214680 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9dc8c172-14a5-4f88-8be6-35c6793a2776 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 204 len: 0 microversion: 2.1 time: 0.332821 Jun 23 11:55:41.221046 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 64/116] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:40 2022] DELETE /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:55:41.232397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:41.235384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:41.250732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.251186 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:41.255424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.258591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:41.505714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:41.509681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:41.512354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:41.520083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-239ccfb5-b486-47df-9441-3ee39967d020 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.296607 Jun 23 11:55:41.522778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1bac3514-0d88-4ab7-84d2-58ad33c4a78b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.641345 Jun 23 11:55:41.523463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 65/117] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:41 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:41.539018 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 53/118] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:40 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 658 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:41.547265 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:41.547660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:41.547866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:41.548278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:41.566375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.567171 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:41.569857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.570314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:41.583340 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.583776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:41.584539 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.598073 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:41.834588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:41.843803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:41.846735 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4e51be12-db79-4b1e-b01f-ae9ce49c04ec tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.321390 Jun 23 11:55:41.847779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 66/119] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:41 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:41.859716 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c610b0a3-a498-4e2f-bd32-66d8d8fa3a9a tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1553 microversion: 2.1 time: 0.319417 Jun 23 11:55:41.860659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 54/120] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:41 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1553 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:41.866612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:41.867572 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:41.881146 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:41.903816 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.904332 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:41.909707 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:41.910835 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.086957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:42.097535 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-731c66a2-e755-4add-86d0-57f40f1461fc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.248478 Jun 23 11:55:42.098230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 67/121] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:41 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:42.158521 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-9efe635f-f532-4f89-b86d-2fd6f8ff7717 req-0f1487d0-5ff1-476c-9327-e85ed71c85bb service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a263d16c-8b58-4f38-8d81-6d2aec398219", "tag": "2c7047e7-2534-4b9b-aace-b311d43e694f"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:42.171009 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-9efe635f-f532-4f89-b86d-2fd6f8ff7717 req-0f1487d0-5ff1-476c-9327-e85ed71c85bb service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.172097 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-9efe635f-f532-4f89-b86d-2fd6f8ff7717 req-0f1487d0-5ff1-476c-9327-e85ed71c85bb service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.188558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-9efe635f-f532-4f89-b86d-2fd6f8ff7717 req-0f1487d0-5ff1-476c-9327-e85ed71c85bb service nova] Creating event network-changed:2c7047e7-2534-4b9b-aace-b311d43e694f for instance a263d16c-8b58-4f38-8d81-6d2aec398219 on hv-cinder-82660 Jun 23 11:55:42.195015 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-9efe635f-f532-4f89-b86d-2fd6f8ff7717 req-0f1487d0-5ff1-476c-9327-e85ed71c85bb service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039385 Jun 23 11:55:42.195726 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 55/122] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:42.539812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:42.540340 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:42.540918 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:42.541440 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:42.548057 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.548491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.548662 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.549113 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.549287 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.549900 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.550005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.550592 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.719373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:42.730060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-63ee987a-aad4-453c-a0db-f5fca069a99e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.193901 Jun 23 11:55:42.736713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 68/123] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:42 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:42.762219 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:42.770471 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-722754df-9952-4daf-add8-00cf402a0f6c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.234355 Jun 23 11:55:42.771142 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 56/124] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:42 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:42.863810 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:42.865432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:42.876560 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:42.877376 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:42.880892 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.884142 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.884962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.885911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.886506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.889839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:42.890639 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:42.891070 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:43.062360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:43.068278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:43.071724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7032fc18-c774-4b22-8b40-cf96cc6b8514 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1553 microversion: 2.1 time: 0.199008 Jun 23 11:55:43.076725 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 57/125] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:42 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1553 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:43.085884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c548cb2e-9c85-4826-ad5b-6bd2a404b25a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.225798 Jun 23 11:55:43.086671 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 69/126] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:42 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:43.117542 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:43.118351 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:43.126809 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:43.127261 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:43.128194 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:43.128608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:43.286988 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:43.296395 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-934ced24-3623-4a21-99ba-ad2c7a2dd8b9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1361 microversion: 2.1 time: 0.185926 Jun 23 11:55:43.297191 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 58/127] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:43 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:43.747477 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:43.748080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:43.756061 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:43.757475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:43.758154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:43.758728 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:43.789599 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:43.790451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:43.800341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:43.801324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:43.802842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:43.803526 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:43.928230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:43.940704 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-92cfc97c-474b-4a3a-9907-d810d6c932b6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1367 microversion: 2.1 time: 0.197069 Jun 23 11:55:43.941405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 70/128] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:43 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1367 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:44.008803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:44.018619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4a180ee4-e22c-4ddd-82dd-e136e5727f62 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.232713 Jun 23 11:55:44.018619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 59/129] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:43 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:44.089785 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:44.090676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:44.096797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.097322 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.098092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.098523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.103398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:44.104020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:44.111361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.111849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.112923 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.113580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.271964 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:44.283064 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b171f62a-0f51-49b8-8af2-73af363fa7a9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.182065 Jun 23 11:55:44.297159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:44.306849 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bfc700bf-73f7-45f0-89a9-968190df1852 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1553 microversion: 2.1 time: 0.221820 Jun 23 11:55:44.311174 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 60/130] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:44 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:44.316907 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:44.317595 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:44.321609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 71/131] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:44 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1553 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:44.325916 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.326639 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.327762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.328392 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.475407 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:44.484004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f7a460a9-1ff7-4839-aaa1-6d4e12d34efc tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1546 microversion: 2.1 time: 0.170877 Jun 23 11:55:44.495264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 61/132] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:44 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1546 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:44.503028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-08352cbf-52fb-4555-90d0-dc01406c58fb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:44.503885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-08352cbf-52fb-4555-90d0-dc01406c58fb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:44.514486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-08352cbf-52fb-4555-90d0-dc01406c58fb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.515151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-08352cbf-52fb-4555-90d0-dc01406c58fb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.516426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-08352cbf-52fb-4555-90d0-dc01406c58fb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.517492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-08352cbf-52fb-4555-90d0-dc01406c58fb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.681965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-08352cbf-52fb-4555-90d0-dc01406c58fb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.183105 Jun 23 11:55:44.682621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 72/133] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 11:55:44 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-interface => generated 285 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:44.959263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:44.960490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:44.962674 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:44.970296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.970756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:44.971541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:44.971978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.035806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:45.037292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:45.045124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.045669 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.046514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.047179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.508956 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:45.520320 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-eeb01a35-aab7-4d40-9b88-cb22211f6a48 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1557 microversion: 2.1 time: 0.565169 Jun 23 11:55:45.537483 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 62/134] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:44 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1557 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:45.543257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:45.544930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:45.554737 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.555567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.556525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.557978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.578553 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:45.586878 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-51c7d05f-d472-4c04-aab3-3b7d8c746318 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.555127 Jun 23 11:55:45.596175 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 73/135] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:45 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 566 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:45.603161 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:45.603992 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:45.612029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.615775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.615775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.615775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.908666 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:45.925699 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-09968706-f070-4523-a913-29203a141a83 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1553 microversion: 2.1 time: 0.327596 Jun 23 11:55:45.926290 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 74/136] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:45 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1553 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:45.931351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9159fa3c-34e9-4ba6-9f64-81a96cf479b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:45.932044 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9159fa3c-34e9-4ba6-9f64-81a96cf479b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:45.954673 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9159fa3c-34e9-4ba6-9f64-81a96cf479b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.955356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9159fa3c-34e9-4ba6-9f64-81a96cf479b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:45.956540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9159fa3c-34e9-4ba6-9f64-81a96cf479b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:45.957156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9159fa3c-34e9-4ba6-9f64-81a96cf479b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:46.061616 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:46.076582 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f8b0b1ff-fedb-4dd2-baf2-3500ce41aac5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.535424 Jun 23 11:55:46.078714 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 63/137] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:45 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 541 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:46.217804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9159fa3c-34e9-4ba6-9f64-81a96cf479b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.289627 Jun 23 11:55:46.218486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 75/138] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 11:55:45 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-interface => generated 284 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:46.604482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:46.605112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:46.611744 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:46.612223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:46.613286 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:46.613935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:46.774208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:46.774982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=8 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:46.779223 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-d42bb03d-1a80-4e61-ba76-77ffedc7e1bc req-fa36a864-3da0-4809-b841-2cadc6d90a02 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c", "name": "network-vif-deleted", "tag": "c1887889-94c0-435d-9dc4-a46cb2e8dbac"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:46.797686 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-d42bb03d-1a80-4e61-ba76-77ffedc7e1bc req-fa36a864-3da0-4809-b841-2cadc6d90a02 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:46.798461 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-d42bb03d-1a80-4e61-ba76-77ffedc7e1bc req-fa36a864-3da0-4809-b841-2cadc6d90a02 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:46.813215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-d42bb03d-1a80-4e61-ba76-77ffedc7e1bc req-fa36a864-3da0-4809-b841-2cadc6d90a02 service nova] Creating event network-vif-deleted:c1887889-94c0-435d-9dc4-a46cb2e8dbac for instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c on hv-cinder-82660 Jun 23 11:55:46.823108 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-d42bb03d-1a80-4e61-ba76-77ffedc7e1bc req-fa36a864-3da0-4809-b841-2cadc6d90a02 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049647 Jun 23 11:55:46.823914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 76/139] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:46.944231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:46.945977 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:46.956603 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:46.959017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:46.960083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:46.961549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:47.000606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:47.013436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4e45fa12-7b8c-4c1c-924a-5f635a8b23fb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.412568 Jun 23 11:55:47.014825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 64/140] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:46 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:47.090720 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-466f8e7c-b8d9-4aa9-b438-c88b23e92bcb req-019e5115-6820-46c6-a302-35d00ebc6d64 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7134bd36-8b37-48ff-bcfb-ab369c0ef601", "tag": "2b1b9605-d448-4f5e-8b07-f5d1a8bf6799"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:47.103795 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-466f8e7c-b8d9-4aa9-b438-c88b23e92bcb req-019e5115-6820-46c6-a302-35d00ebc6d64 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:47.104573 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-466f8e7c-b8d9-4aa9-b438-c88b23e92bcb req-019e5115-6820-46c6-a302-35d00ebc6d64 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:47.118169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:47.120835 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-466f8e7c-b8d9-4aa9-b438-c88b23e92bcb req-019e5115-6820-46c6-a302-35d00ebc6d64 service nova] Creating event network-changed:2b1b9605-d448-4f5e-8b07-f5d1a8bf6799 for instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 on hv-cinder-82660 Jun 23 11:55:47.127039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-466f8e7c-b8d9-4aa9-b438-c88b23e92bcb req-019e5115-6820-46c6-a302-35d00ebc6d64 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040837 Jun 23 11:55:47.128226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 65/141] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:55:47.133686 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7d984e51-d8cd-4aef-887b-b1c3abc1dc25 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1345 microversion: 2.1 time: 0.194429 Jun 23 11:55:47.134275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 77/142] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:46 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1345 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:47.137063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:47.137983 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:47.145092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:47.145805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:47.148058 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:47.150783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:47.318774 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:47.331215 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8a6fa4f9-56a3-409b-8626-f5c2276130b2 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.201562 Jun 23 11:55:47.332212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 66/143] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:47 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:48.032563 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:48.033869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:48.066831 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:48.067208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:48.068004 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:48.068443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:48.151616 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:48.152250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:48.166457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:48.166920 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:48.171807 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:48.172857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:48.218970 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:48.219729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:48.220498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lazy-loading 'fault' on Instance uuid d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:55:48.326203 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3435419f72349b68c62a76638f98812', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '6c041fd4759140b6926efa8c1a4935f7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:48.339862 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5aaa6d27-1e08-4f99-98e6-f5d5713cdb49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 200 len: 1350 microversion: 2.1 time: 0.193753 Jun 23 11:55:48.340854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 67/144] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:48 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 1350 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:48.349690 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:48.356278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:48.358045 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:48.364778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:48.365235 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:48.366018 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:48.366484 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:48.370088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-77a0c2d5-b4cb-4301-a4b5-1bdb5f242178 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.342455 Jun 23 11:55:48.379500 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 78/145] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:48 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:48.608219 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:48.617320 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f49556f1-4c27-42cd-8737-3f8312cb0432 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.271720 Jun 23 11:55:48.627112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 68/146] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:48 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:49.180929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-5186f932-192e-4641-a65f-ac0f196ad1ea req-99a6f31a-3867-496b-b4cb-9c0a70bcc682 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d67c82c1-7c40-43a6-9326-480dc5fcb37a", "tag": "aa6285e7-0658-4131-aef9-e0151dcf7912"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:49.200032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-5186f932-192e-4641-a65f-ac0f196ad1ea req-99a6f31a-3867-496b-b4cb-9c0a70bcc682 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.200694 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-5186f932-192e-4641-a65f-ac0f196ad1ea req-99a6f31a-3867-496b-b4cb-9c0a70bcc682 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.214865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-5186f932-192e-4641-a65f-ac0f196ad1ea req-99a6f31a-3867-496b-b4cb-9c0a70bcc682 service nova] Creating event network-changed:aa6285e7-0658-4131-aef9-e0151dcf7912 for instance d67c82c1-7c40-43a6-9326-480dc5fcb37a on hv-cinder-82660 Jun 23 11:55:49.223133 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-5186f932-192e-4641-a65f-ac0f196ad1ea req-99a6f31a-3867-496b-b4cb-9c0a70bcc682 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.053594 Jun 23 11:55:49.226395 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 79/147] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:49.358371 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:49.359597 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:49.368278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.369132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.370141 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.370779 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.390108 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:49.390998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:49.392413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] HTTP exception thrown: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Request method failure captured: Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c HTTP/1.1 Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSODN8jU2PvuyryruqYSsDFVSSYrKsVBds56qcd4m5-2nrC2UugjnesS0XmczAAp53Pei0dcStwdY5M5JYlh4FVlT2SzcA4eigVCJ0624-QpBRpT1bOVvRPuPPtV2IhzmmsFo4F268yAGr0wcSPAehSok8MR0orACXXo3Zv0ktiI84 Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:55:49.398906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: c3435419f72349b68c62a76638f98812 Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.400111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'd4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c'} Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:49.400833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.402170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.405092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Returning 404 to user: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:49.406167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9ed10656-8943-40d7-9935-b7d90cb5b6d1 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 404 len: 111 microversion: 2.1 time: 0.052013 Jun 23 11:55:49.407443 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 69/148] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:49 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:49.414181 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.417543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.421502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.423457 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.607688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:49.609507 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:49.641027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.641848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.642786 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.645521 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.681248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] HTTP exception thrown: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Request method failure captured: Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c/os-volume_attachments HTTP/1.1 Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSODN8jU2PvuyryruqYSsDFVSSYrKsVBds56qcd4m5-2nrC2UugjnesS0XmczAAp53Pei0dcStwdY5M5JYlh4FVlT2SzcA4eigVCJ0624-QpBRpT1bOVvRPuPPtV2IhzmmsFo4F268yAGr0wcSPAehSok8MR0orACXXo3Zv0ktiI84 Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:55:49.691849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: c3435419f72349b68c62a76638f98812 Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.693566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'server_id': 'd4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c'} Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:49.694291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:49.695361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:49.696403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Returning 404 to user: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:49.696403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-76eee157-9587-412c-afe8-713ba89d8e49 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.091173 Jun 23 11:55:49.696403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 70/149] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 11:55:49 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c/os-volume_attachments => generated 111 bytes in 93 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:49.702866 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:49.709167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:49.734405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.736192 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.737190 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:49.738250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:49.848037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:49.859107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7b27a7f2-5a9f-4498-a6a2-5ca816ed70ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.475465 Jun 23 11:55:49.860127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 80/150] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:49 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:50.201539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:50.212913 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-54a53045-a78f-4454-95a9-96cb4451d6c9 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.516365 Jun 23 11:55:50.213679 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 71/151] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:49 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:50.876463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:50.877085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:50.883025 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:50.883467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:50.884220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:50.884643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:51.023613 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:51.031395 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4a95796f-55e4-42ed-8ab4-e616780dca71 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.158729 Jun 23 11:55:51.032308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 81/152] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:50 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:51.045334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:51.045963 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:51.052997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:51.053451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:51.054451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:51.054890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:51.068528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] HTTP exception thrown: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Request method failure captured: Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c HTTP/1.1 Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSODN8jU2PvuyryruqYSsDFVSSYrKsVBds56qcd4m5-2nrC2UugjnesS0XmczAAp53Pei0dcStwdY5M5JYlh4FVlT2SzcA4eigVCJ0624-QpBRpT1bOVvRPuPPtV2IhzmmsFo4F268yAGr0wcSPAehSok8MR0orACXXo3Zv0ktiI84 Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:55:51.070637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: c3435419f72349b68c62a76638f98812 Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.071886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'd4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c'} Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:51.072536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.073659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.074761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Returning 404 to user: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:51.074761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d0eb635c-3a37-4dc5-94a8-9892cbed6a53 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 404 len: 111 microversion: 2.1 time: 0.031194 Jun 23 11:55:51.074761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 72/153] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:55:51 2022] DELETE /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:55:51.080510 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:51.081140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] [instance: d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:51.091088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:51.091865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:51.093240 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:51.093716 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:51.108598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] HTTP exception thrown: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Request method failure captured: Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c HTTP/1.1 Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSODN8jU2PvuyryruqYSsDFVSSYrKsVBds56qcd4m5-2nrC2UugjnesS0XmczAAp53Pei0dcStwdY5M5JYlh4FVlT2SzcA4eigVCJ0624-QpBRpT1bOVvRPuPPtV2IhzmmsFo4F268yAGr0wcSPAehSok8MR0orACXXo3Zv0ktiI84 Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 11:55:51.113283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_6c041fd4759140b6926efa8c1a4935f7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: 6c041fd4759140b6926efa8c1a4935f7 Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-DeleteServersTestJSON-1538316573 Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: c3435419f72349b68c62a76638f98812 Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-DeleteServersTestJSON-1538316573-project Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.114683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'd4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c'} Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:55:51.115409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. Jun 23 11:55:51.116957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:55:51.118023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] Returning 404 to user: Instance d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:55:51.118023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-02509db8-5cd8-434e-920f-e1fc04ee43b0 tempest-DeleteServersTestJSON-1538316573 tempest-DeleteServersTestJSON-1538316573-project] 10.222.0.67 "GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c" status: 404 len: 111 microversion: 2.1 time: 0.037937 Jun 23 11:55:51.118023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 82/154] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:51 2022] GET /compute/v2.1/servers/d4d77d8b-5e6d-4d69-a4a3-cb0ee521e33c => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:55:51.230660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:51.231380 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:51.238389 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:51.239294 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:51.240518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:51.241249 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:51.260103 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:51.414480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:51.423158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5f64c4f1-277d-4c8c-bb39-e8ea36a7b308 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.196279 Jun 23 11:55:51.423891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 73/155] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:51 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:52.049375 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:52.049900 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:52.057754 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:52.058293 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:52.059271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:52.059711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:52.312894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:52.321542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5258b81d-c977-4da0-ae0e-cd3120029826 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.276681 Jun 23 11:55:52.322138 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 83/156] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:52 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:52.441905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:52.442540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:52.452554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:52.454357 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:52.455429 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:52.456339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:52.597589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:52.605633 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-877ad035-82b6-49df-8a14-a3fe7b55395d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.168018 Jun 23 11:55:52.606451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 74/157] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:52 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:52.923799 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-1d58d0e5-580a-4fb7-a7c0-db86be4be45e req-7f70a16f-9bca-4e0d-b766-d1bff189f144 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a263d16c-8b58-4f38-8d81-6d2aec398219", "name": "network-vif-plugged", "status": "completed", "tag": "2c7047e7-2534-4b9b-aace-b311d43e694f"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:52.932211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-1d58d0e5-580a-4fb7-a7c0-db86be4be45e req-7f70a16f-9bca-4e0d-b766-d1bff189f144 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:52.932684 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-1d58d0e5-580a-4fb7-a7c0-db86be4be45e req-7f70a16f-9bca-4e0d-b766-d1bff189f144 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:52.936919 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:55:52.945241 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-1d58d0e5-580a-4fb7-a7c0-db86be4be45e req-7f70a16f-9bca-4e0d-b766-d1bff189f144 service nova] Creating event network-vif-plugged:2c7047e7-2534-4b9b-aace-b311d43e694f for instance a263d16c-8b58-4f38-8d81-6d2aec398219 on hv-cinder-82660 Jun 23 11:55:52.951496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-1d58d0e5-580a-4fb7-a7c0-db86be4be45e req-7f70a16f-9bca-4e0d-b766-d1bff189f144 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031382 Jun 23 11:55:52.952272 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 84/158] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:55:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:55:53.337975 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:53.338589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:53.344744 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:53.345205 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:53.346034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:53.346474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:53.575540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:53.583686 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e18ed34d-be63-4e42-9c7b-124267834e10 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.249475 Jun 23 11:55:53.584424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 75/159] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:53 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:53.624986 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:53.626516 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:53.633588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:53.634120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:53.634962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:53.635466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:53.779470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:53.787808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-06cb5aba-fd6d-4b34-8d00-1f703607d640 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.167623 Jun 23 11:55:53.789248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 85/160] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:53 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:55:54.601544 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:54.602293 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:54.612553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:54.612782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:54.613558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:54.614196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:54.808240 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:54.808939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:54.816168 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:54.816961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:54.818091 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:54.818767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:54.925547 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:54.937219 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4cbbd7ad-8c38-4a35-9468-5fb8d06e1807 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.340089 Jun 23 11:55:54.938346 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 76/161] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:54 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:55.007081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:55.015548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-98249fe8-05e6-42a9-9145-6a1f80eacf43 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1319 microversion: 2.1 time: 0.213268 Jun 23 11:55:55.017096 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 86/162] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:54 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1319 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:55.954478 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:55.955734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:55.968263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:55.968720 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:55.969509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:55.969939 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:56.034874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:56.036378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:56.048354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:56.049458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:56.050589 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:56.051358 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:56.309145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:56.323004 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-77951efb-c030-47b4-8d0c-9472f4c858d0 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1508 microversion: 2.1 time: 0.292611 Jun 23 11:55:56.337119 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 87/163] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:56 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1508 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:56.337549 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:56.342294 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9e11845b-cbd9-4554-8004-5f9f6c9091ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.385351 Jun 23 11:55:56.343081 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 77/164] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:55 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:57.363758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:57.364445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:57.382851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:57.383695 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:57.385026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:57.385703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:57.576609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:57.587716 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cf99338d-e060-498b-af30-87f8d4fb1d6d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.231048 Jun 23 11:55:57.588363 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 88/165] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:57 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:58.607589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:58.608206 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:58.615254 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:58.615697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:58.616453 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:58.616919 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:58.784985 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:58.799650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5bd1e178-ee9f-4926-a181-13f5def0f0eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.197255 Jun 23 11:55:58.800301 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 78/166] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:58 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:55:59.816544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:55:59.817252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:55:59.824129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:59.824573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:59.825436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:55:59.826038 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:55:59.835146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1133532700", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "networks": [{"uuid": "0df3fa49-0f7b-40b9-8b25-856e85e676ae"}]}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:55:59.887981 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] validate_networks() for [('0df3fa49-0f7b-40b9-8b25-856e85e676ae', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:55:59.963157 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:55:59.970709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fadeb575-7558-44ec-8c98-11855debfc4d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.158021 Jun 23 11:55:59.971291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 89/167] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:55:59 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:00.277405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:56:00.277988 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:56:00.278472 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:56:00.278883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:56:00.279295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:56:00.289264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:00.289761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:00.290668 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:00.291105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:00.310010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Getting quotas for project d4f7063c9ea64b569c3699a45ad0bb2e. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:56:00.314035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Getting quotas for user 23a9ad25030045b9b5dad89eadca1b9c and project d4f7063c9ea64b569c3699a45ad0bb2e. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:56:00.327026 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:56:00.329339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:56:00.383237 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5662481a-de44-4c99-ac22-ad458203e014 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.556338 Jun 23 11:56:00.384223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 79/168] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:55:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 558 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:56:00.395756 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3714d14a-c896-48fa-9d1a-d32e6cb0f386 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:00.398133 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3714d14a-c896-48fa-9d1a-d32e6cb0f386 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:00.466564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3714d14a-c896-48fa-9d1a-d32e6cb0f386 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:00.474578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3714d14a-c896-48fa-9d1a-d32e6cb0f386 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1214 microversion: 2.1 time: 0.084401 Jun 23 11:56:00.475486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 90/169] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:00 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1214 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:00.987453 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:00.988239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:00.994612 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:00.995061 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:00.995823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:00.996257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:01.135871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:01.143421 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2c309d15-6b34-456f-bc9e-bf474eb664d1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.159994 Jun 23 11:56:01.143981 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 80/170] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:00 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:01.492601 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:01.493243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:01.499352 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:01.499799 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:01.500560 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:01.501030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:01.569779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:01.577215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-561aa4de-e307-4953-aefc-c4bdba02cb23 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1266 microversion: 2.1 time: 0.088532 Jun 23 11:56:01.577779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 91/171] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:01 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1266 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:02.160621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:02.161266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:02.168051 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:02.168499 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:02.169562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:02.169984 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:02.529636 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:02.537367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9b0a63fd-c594-4b65-8309-a4eec8c9597f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.380657 Jun 23 11:56:02.538081 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 81/172] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:02 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:02.594715 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:02.595315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:02.601354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:02.601792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:02.602547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:02.602966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:02.662653 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:02.670485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a2ab5769-9894-44a0-b053-9301953682c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1266 microversion: 2.1 time: 0.079551 Jun 23 11:56:02.671050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 92/173] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:02 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1266 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:03.554635 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:03.555277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:03.561868 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:03.562350 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:03.563210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:03.563676 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:03.687384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:03.688554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:03.694962 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:03.695316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:03.695754 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:03.696514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:03.696960 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:03.702496 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3851f197-0be8-4985-9c79-e0aad9b58abd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.152255 Jun 23 11:56:03.703060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 82/174] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:03 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:03.757749 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:03.765397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-44fa47e2-c8a7-490e-8221-fadfd1bed955 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1266 microversion: 2.1 time: 0.081867 Jun 23 11:56:03.765966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 93/175] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:03 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1266 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:04.723325 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:04.724185 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:04.735124 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:04.735747 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:04.736591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:04.737229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:04.783291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:04.783906 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:04.790250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:04.790776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:04.791652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:04.792337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:04.882707 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:04.890712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3dddf6d2-3fd0-44cb-bb35-3d538ce6ee90 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1272 microversion: 2.1 time: 0.111401 Jun 23 11:56:04.902869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 94/176] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:04 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1272 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:05.026038 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:05.039370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b53ff3a7-d2ff-4e0e-92f0-9e33e4ddacff tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.320313 Jun 23 11:56:05.042929 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 83/177] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:04 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:05.909106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:05.909644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:05.915742 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:05.916256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:05.917083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:05.917508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:06.051725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:06.055887 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:06.056379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:06.061707 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-52b1161e-b68a-47c5-92ba-c0c6d5d31d22 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.156393 Jun 23 11:56:06.062389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 95/178] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:05 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:06.063694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:06.064147 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:06.065187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:06.065782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:06.068079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-8ad82e60-4a5c-4d4f-a265-eb500e9ebada req-82f28601-9b2e-4662-841b-284e9f08f537 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8760ad6a-5631-43c7-89a9-afd5491bc706", "tag": "1522c864-471b-4496-ba59-78b84787cb06"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:06.077600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-8ad82e60-4a5c-4d4f-a265-eb500e9ebada req-82f28601-9b2e-4662-841b-284e9f08f537 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:06.078315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-8ad82e60-4a5c-4d4f-a265-eb500e9ebada req-82f28601-9b2e-4662-841b-284e9f08f537 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:06.093185 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-8ad82e60-4a5c-4d4f-a265-eb500e9ebada req-82f28601-9b2e-4662-841b-284e9f08f537 service nova] Creating event network-changed:1522c864-471b-4496-ba59-78b84787cb06 for instance 8760ad6a-5631-43c7-89a9-afd5491bc706 on hv-cinder-82660 Jun 23 11:56:06.098669 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-8ad82e60-4a5c-4d4f-a265-eb500e9ebada req-82f28601-9b2e-4662-841b-284e9f08f537 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034229 Jun 23 11:56:06.099345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 96/179] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:06.273808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:06.281650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d9da9b5a-50bc-43ad-8c39-7ed16a250e27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.229958 Jun 23 11:56:06.282307 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 84/180] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:06 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:07.080252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:07.081114 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:07.088259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:07.088818 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:07.089774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:07.090433 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:07.243234 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:07.251113 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cd53ad39-4e08-4ca3-bf62-493bf26165a9 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.175174 Jun 23 11:56:07.252737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 97/181] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:07 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:07.299150 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:07.299766 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:07.307261 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:07.307776 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:07.308613 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:07.309159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:07.511276 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:07.519717 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a396b287-3b76-45b1-8423-b4d8d0522ec5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.224422 Jun 23 11:56:07.520305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 85/182] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:07 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:08.270143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:08.270848 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:08.277868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:08.278312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:08.279250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:08.279859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:08.440026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:08.451520 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-253e4920-f619-4e68-ad0e-dd672fae3d6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.184421 Jun 23 11:56:08.451520 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 98/183] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:08 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:08.537612 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:08.538884 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:08.545791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:08.546373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:08.547366 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:08.547876 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:08.747550 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:08.755442 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8043bd74-8d33-4fca-8a56-7fd4858d23b4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.222702 Jun 23 11:56:08.757187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 86/184] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:08 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:09.467778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:09.469047 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:09.476508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:09.477301 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:09.479119 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:09.479847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:09.697187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:09.708199 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3ada40c3-fd5a-4be2-8ccb-b0eb05317ec2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.244155 Jun 23 11:56:09.712015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 99/185] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:09 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:09.775759 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:09.776663 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:09.784719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:09.785733 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:09.786759 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:09.787434 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:10.000641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:10.012622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-70acb63b-5266-47f9-a417-a908516f8aa0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.241829 Jun 23 11:56:10.013271 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 87/186] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:09 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:10.733556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:10.734602 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:10.743607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:10.751309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:10.751875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:10.753216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:10.754361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:10.924698 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:10.934029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1a1fe8e3-22ce-4caf-b88d-326bf5a6c30c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.209749 Jun 23 11:56:10.934621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 100/187] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:10 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:11.030538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:11.031300 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:11.034615 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:11.035229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=6 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:11.040710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:11.041187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:11.041959 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:11.042391 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:11.239246 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:11.247993 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ef0b4e39-0671-458d-98db-c2d93229453d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.221292 Jun 23 11:56:11.248577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 88/188] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:11 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:11.951584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:11.952233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:11.954260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=69 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:11.959696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:11.960154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:11.961504 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:11.961949 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:12.094458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:12.102363 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-35574a95-18f4-4e2a-a3c8-c0960819f7c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.154846 Jun 23 11:56:12.102871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 101/189] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:11 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:12.264808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:12.265421 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:12.272309 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:12.272794 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:12.274140 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:12.274579 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:12.403493 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:12.411214 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a8f11beb-e6aa-4b43-a7a1-688854a97bdf tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.150373 Jun 23 11:56:12.411782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 89/190] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:12 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:13.067403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-c18b0764-fbec-47c9-b39f-93dfae2653dc req-d7aa5858-bc26-4b7e-841a-15007de78f75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8760ad6a-5631-43c7-89a9-afd5491bc706", "name": "network-vif-plugged", "status": "completed", "tag": "1522c864-471b-4496-ba59-78b84787cb06"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:13.078422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-c18b0764-fbec-47c9-b39f-93dfae2653dc req-d7aa5858-bc26-4b7e-841a-15007de78f75 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:13.078872 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-c18b0764-fbec-47c9-b39f-93dfae2653dc req-d7aa5858-bc26-4b7e-841a-15007de78f75 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:13.092527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-c18b0764-fbec-47c9-b39f-93dfae2653dc req-d7aa5858-bc26-4b7e-841a-15007de78f75 service nova] Creating event network-vif-plugged:1522c864-471b-4496-ba59-78b84787cb06 for instance 8760ad6a-5631-43c7-89a9-afd5491bc706 on hv-cinder-82660 Jun 23 11:56:13.101500 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-c18b0764-fbec-47c9-b39f-93dfae2653dc req-d7aa5858-bc26-4b7e-841a-15007de78f75 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037432 Jun 23 11:56:13.102538 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 102/191] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:13.118961 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:13.119574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:13.127700 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:13.130276 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:13.134010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:13.137357 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:13.288524 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:13.291506 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:13.298106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8e32dd08-026a-4567-b872-69bae192f61c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.183684 Jun 23 11:56:13.298676 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 90/192] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:13 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:13.429697 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:13.430326 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:13.436550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:13.437024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:13.437775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:13.438206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:13.575303 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:13.577649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:13.584464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3de95c62-91f9-46f6-86fb-25c83094cebc tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.159047 Jun 23 11:56:13.585087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 103/193] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:13 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:14.315403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:14.316002 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:14.323030 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:14.323474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:14.324221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:14.324649 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:14.459017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:14.467431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4cc099d4-00c7-476e-931c-19531b58d7a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.155804 Jun 23 11:56:14.468000 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 91/194] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:14 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:14.602030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:14.602580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:14.608598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:14.609080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:14.609887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:14.610325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:14.749187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:14.756638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-58585d4d-96ef-498e-a981-ef7b5e7378b8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.158830 Jun 23 11:56:14.757314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 104/195] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:14 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:15.483304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:15.483906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:15.486577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=73,nova_api:INSERT=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:15.492207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:15.492652 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:15.493443 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:15.493878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:15.623110 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:15.630673 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-25bae2fa-75ed-4a42-93fc-50cc3bece649 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.151196 Jun 23 11:56:15.631238 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 92/196] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:15 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:15.774846 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:15.775439 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:15.781638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:15.782123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:15.782921 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:15.783472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:15.913460 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:15.921206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-72ff6b3b-1471-4e86-8bea-e7acf9588715 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.150707 Jun 23 11:56:15.921779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 105/197] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:15 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:16.647560 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:16.648516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:16.655161 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.661724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:16.661724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.661724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:16.808173 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:16.815697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-27abd368-89b9-4fa8-9053-a57501256c81 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.172111 Jun 23 11:56:16.816266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 93/198] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:16 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:16.937939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:16.938539 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:16.944494 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.945612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:16.946366 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:16.946788 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:17.072879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:17.080293 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-16c1a0fd-389c-434c-aa5f-c26dd6cdb292 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.146200 Jun 23 11:56:17.080893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 106/199] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:16 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:17.833498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:17.834108 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:17.840996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:17.841440 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:17.842202 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:17.846353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:17.989994 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:17.997425 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-270f41fd-54ce-44ec-a313-a51bab5e9ed4 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.167934 Jun 23 11:56:17.997996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 94/200] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:17 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:18.097123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:18.097733 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:18.103813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:18.104265 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:18.105059 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:18.105492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:18.237159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:18.244811 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d098550f-bcab-4edb-9ef9-2801e55b3b2c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.151530 Jun 23 11:56:18.245388 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 107/201] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:18 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:19.014229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:19.014840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:19.021406 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:19.021793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:19.022554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:19.022992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:19.150627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:19.158060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-292e4024-8ddc-444c-8012-eb965c88aac8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.147725 Jun 23 11:56:19.158623 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 95/202] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:19 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:19.268411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:19.268411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:19.274114 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:19.274550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:19.275692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:19.276176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:19.402401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:19.409913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ac5b6696-87f1-42b0-b3db-0ff8f62374f3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.147451 Jun 23 11:56:19.410482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 108/203] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:19 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:20.175729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:20.176344 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:20.182854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.183304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.184064 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.184498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.316111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:20.324411 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c8d9f7e7-58af-4202-84de-64a4cf576490 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.152585 Jun 23 11:56:20.325005 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 96/204] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:20 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:20.427696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:20.428211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:20.434288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.434739 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.435504 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:20.435939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:20.566632 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:20.574553 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-78ab29d9-3af1-422c-a971-3733fbd7f0de tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.150878 Jun 23 11:56:20.575120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 109/205] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:20 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:21.341212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:21.341817 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:21.348345 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:21.348833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:21.349602 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:21.350046 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:21.479730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:21.487144 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e6413d3d-b63f-4662-a9f3-f5caeca39a1a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.149748 Jun 23 11:56:21.487703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 97/206] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:21 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:21.591800 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:21.592316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:21.598430 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:21.598876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:21.599667 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:21.600102 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:21.730228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:21.737745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f3bd322e-3aa4-46b1-a624-3bfe479ba9f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.149896 Jun 23 11:56:21.738323 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 110/207] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:21 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:22.503764 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:22.504395 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:22.511600 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.512027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.512808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.513240 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.649457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:22.657079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d7c878af-1cd3-4ede-9a47-ef717c1ac3fc tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.157049 Jun 23 11:56:22.657654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 98/208] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:22 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:22.757100 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:22.757699 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:22.763854 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.764305 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.765105 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:22.765548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:22.892834 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:22.900890 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9ef612a2-def8-4ab5-afc2-d6350181b770 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1521 microversion: 2.1 time: 0.148231 Jun 23 11:56:22.901407 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 111/209] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:22 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:23.674658 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:23.675211 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:23.681804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.682255 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:23.683022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.683454 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:23.811459 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:23.818995 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-286486af-1924-4992-aa15-6db05723d31d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1314 microversion: 2.1 time: 0.148238 Jun 23 11:56:23.819611 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 99/210] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:23 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:23.918450 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:23.919251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:23.937231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.937866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:23.940551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:23.940551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.088243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:24.096097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c9390e5e-39be-4975-9083-ca64cb0ad28c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1501 microversion: 2.1 time: 0.182345 Jun 23 11:56:24.096876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 112/211] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:23 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1501 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:24.112326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:24.113023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:24.119187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.119638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.120448 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.120913 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.258861 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:24.266583 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4072e36e-9e7a-4c3d-a70b-389b02a33501 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1516 microversion: 2.1 time: 0.158200 Jun 23 11:56:24.280531 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 100/212] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:24 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1516 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:24.835575 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:24.836176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:24.842260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.842736 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.843481 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:24.843917 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:24.970679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:24.979429 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-63003579-70c5-4f71-99fb-851248dbdcb5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1498 microversion: 2.1 time: 0.147704 Jun 23 11:56:24.979995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 113/213] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:24 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1498 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:25.583876 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-25fbafef-b681-4961-bd70-d5a18390fccc tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bd48806e-2a04-4ec0-bdeb-57cef804b4ef", "device": "/dev/sdb"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:25.585573 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-25fbafef-b681-4961-bd70-d5a18390fccc tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:25.592631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25fbafef-b681-4961-bd70-d5a18390fccc tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:25.593132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25fbafef-b681-4961-bd70-d5a18390fccc tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:25.593892 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25fbafef-b681-4961-bd70-d5a18390fccc tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:25.594353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25fbafef-b681-4961-bd70-d5a18390fccc tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:26.983317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-25fbafef-b681-4961-bd70-d5a18390fccc tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "POST /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.403244 Jun 23 11:56:26.984318 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 101/214] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:56:25 2022] POST /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219/os-volume_attachments => generated 194 bytes in 1405 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:32.007301 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:32.007886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:32.014666 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:32.015113 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:32.015885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:32.016392 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:32.042191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:56:32.123612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-25e13282-0675-4d27-a097-f48279b876f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "DELETE /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 204 len: 0 microversion: 2.1 time: 0.119715 Jun 23 11:56:32.127553 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 114/215] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:56:32 2022] DELETE /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 0 bytes in 121 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:56:32.135589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:32.136368 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:32.143755 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:32.144205 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:32.145061 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:32.145494 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:32.285928 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:32.294032 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7da27346-044b-4596-99bf-fcd67a33e5f8 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1504 microversion: 2.1 time: 0.165159 Jun 23 11:56:32.294832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 102/216] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:32 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1504 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:32.981702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:32.983267 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:32.990452 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:32.990903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:32.991680 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:32.992123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:33.021616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lazy-loading 'flavor' on Instance uuid e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:56:33.104248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1cf12ff4-8b90-4c9e-b3f0-090e54999e5f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50/action" status: 200 len: 32 microversion: 2.1 time: 0.126426 Jun 23 11:56:33.104910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 115/217] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:56:32 2022] POST /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50/action => generated 32 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 11:56:33.113942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:33.114559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:33.121837 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:33.122288 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:33.123071 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:33.123510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:33.277688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:33.290158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fe6020c0-8f61-46b3-9083-f55c1c365ed1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.179555 Jun 23 11:56:33.291638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 103/218] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:33 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:33.313995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:33.314758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:33.329067 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:33.329818 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:33.330648 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:33.331134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:33.495964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:33.498312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:33.505423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8e476c19-dd61-4cb7-9804-9ffe8ca90256 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1504 microversion: 2.1 time: 0.197025 Jun 23 11:56:33.506081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 116/219] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:33 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1504 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:34.308169 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:34.308737 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:34.315180 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:34.315620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:34.316367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:34.316825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:34.447782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:34.455234 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5ae61bab-9902-40ba-8103-cd038bf7cb1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.150954 Jun 23 11:56:34.455806 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 104/220] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:34 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:34.530300 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:34.531027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:34.539003 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:34.539526 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:34.540368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:34.540909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:34.674248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:34.681912 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-67f216f0-2e9d-4c79-afdb-f593c61cc783 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1504 microversion: 2.1 time: 0.157075 Jun 23 11:56:34.682484 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 117/221] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:34 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1504 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:35.472705 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:35.473311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:35.480270 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:35.480746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:35.481510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:35.481948 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:35.620622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:35.628072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-50299a2f-c777-409d-8250-e6e46254bd6f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.159338 Jun 23 11:56:35.628638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 105/222] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:35 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:35.699065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:35.699669 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:35.705725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:35.706172 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:35.706931 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:35.707361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:35.835256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:35.843565 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-41f2da51-82bc-4782-a105-da23743df780 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1504 microversion: 2.1 time: 0.148940 Jun 23 11:56:35.844136 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 118/223] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:35 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1504 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:36.645645 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:36.646334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:36.652913 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.653358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.654124 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.654559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.657289 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:36.785900 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:36.793900 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f9661d23-9831-4e7d-8d39-94383ca05c4b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.152236 Jun 23 11:56:36.794471 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 106/224] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:36 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:36.861156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:36.861707 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:36.868548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.869051 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:36.870042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:36.870480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:37.004612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:37.012807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-96ba1b90-e33f-47b1-ac9d-d728d46c2533 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1504 microversion: 2.1 time: 0.155525 Jun 23 11:56:37.013393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 119/225] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:36 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1504 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:37.812086 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:37.814540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:37.821816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:37.822266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:37.823065 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:37.823431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:37.873438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-7d81c9bf-b29f-4985-88b2-6cc105d32bd6 req-d41ae1bb-d4c1-4613-98af-37d2afb2889a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8760ad6a-5631-43c7-89a9-afd5491bc706", "name": "network-vif-deleted", "tag": "1522c864-471b-4496-ba59-78b84787cb06"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:37.885515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7d81c9bf-b29f-4985-88b2-6cc105d32bd6 req-d41ae1bb-d4c1-4613-98af-37d2afb2889a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:37.886033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7d81c9bf-b29f-4985-88b2-6cc105d32bd6 req-d41ae1bb-d4c1-4613-98af-37d2afb2889a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:37.905718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-7d81c9bf-b29f-4985-88b2-6cc105d32bd6 req-d41ae1bb-d4c1-4613-98af-37d2afb2889a service nova] Creating event network-vif-deleted:1522c864-471b-4496-ba59-78b84787cb06 for instance 8760ad6a-5631-43c7-89a9-afd5491bc706 on hv-cinder-82660 Jun 23 11:56:37.911058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-7d81c9bf-b29f-4985-88b2-6cc105d32bd6 req-d41ae1bb-d4c1-4613-98af-37d2afb2889a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041230 Jun 23 11:56:37.911990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 120/226] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:37.977457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:37.985642 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7e52249e-4980-404b-a9f4-e1f684f7f088 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.177695 Jun 23 11:56:37.986208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 107/227] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:37 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:38.030493 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:38.031506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:38.037819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:38.038257 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:38.039019 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:38.040406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:38.108360 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:38.116148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f783d124-0ac6-48bc-8a9f-4bc2c476f001 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 200 len: 1299 microversion: 2.1 time: 0.090638 Jun 23 11:56:38.116758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 121/228] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:38 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 1299 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:39.002513 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:39.003617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:39.011017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.011588 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.012486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.013343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.133389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:39.134008 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 8760ad6a-5631-43c7-89a9-afd5491bc706] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:39.139977 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.140424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.141228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.141665 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.155360 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] HTTP exception thrown: Instance 8760ad6a-5631-43c7-89a9-afd5491bc706 could not be found. Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Request method failure captured: Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 HTTP/1.1 Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFTOTTzHlYGLVCMtp5i5Fi7K-q9an3_QEAIeexHq2_MBinqeb5RkY0jAN7Aw9M2opiBRQG1gT-VDZGrbaLaWwh9QzDRRd2DWw5pSFVxpoOzI1G2QdKsMkNcYGJJDu9ynDrF8f3gg6Lfel9SWtzzTK_o8oj66c4OW8I3TCUmlAR7yTj4 Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: d4f7063c9ea64b569c3699a45ad0bb2e Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-VolumesActionsTest-1023231657 Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 11:56:39.157068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-VolumesActionsTest-1023231657 Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: d4f7063c9ea64b569c3699a45ad0bb2e Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-VolumesActionsTest-1023231657 Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-VolumesActionsTest-1023231657-project Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 23a9ad25030045b9b5dad89eadca1b9c Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-VolumesActionsTest-1023231657-project Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance 8760ad6a-5631-43c7-89a9-afd5491bc706 could not be found. Jun 23 11:56:39.158527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '8760ad6a-5631-43c7-89a9-afd5491bc706'} Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8760ad6a-5631-43c7-89a9-afd5491bc706 could not be found. Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:56:39.159542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8760ad6a-5631-43c7-89a9-afd5491bc706 could not be found. Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8760ad6a-5631-43c7-89a9-afd5491bc706 could not be found. Jun 23 11:56:39.160658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:56:39.161839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Returning 404 to user: Instance 8760ad6a-5631-43c7-89a9-afd5491bc706 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:56:39.161839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5f0c5812-8f7b-45d6-8e3f-b60a92daa88d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706" status: 404 len: 111 microversion: 2.1 time: 0.029072 Jun 23 11:56:39.161839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 122/229] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:39 2022] GET /compute/v2.1/servers/8760ad6a-5631-43c7-89a9-afd5491bc706 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:56:39.162079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:39.171476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-555225ab-4067-4c6c-b57d-84a2fa2131ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.171865 Jun 23 11:56:39.171476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 108/230] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:38 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:39.261867 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1182015158", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "networks": [{"uuid": "0df3fa49-0f7b-40b9-8b25-856e85e676ae"}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:39.329545 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] validate_networks() for [('0df3fa49-0f7b-40b9-8b25-856e85e676ae', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:56:39.678798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:56:39.679224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:56:39.679697 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:56:39.680112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:56:39.680551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:56:39.689939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.690384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.691182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:39.691620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:39.709376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Getting quotas for project d4f7063c9ea64b569c3699a45ad0bb2e. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:56:39.713323 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Getting quotas for user 23a9ad25030045b9b5dad89eadca1b9c and project d4f7063c9ea64b569c3699a45ad0bb2e. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:56:39.727260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:56:39.730159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:56:39.774635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-384b5ca4-77fc-4c82-8862-0947008d53fb tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.516727 Jun 23 11:56:39.775272 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 123/231] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:56:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 518 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:56:39.785146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5b8340b2-e03f-47c4-a139-db779be7cb31 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:39.785840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5b8340b2-e03f-47c4-a139-db779be7cb31 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:39.839860 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5b8340b2-e03f-47c4-a139-db779be7cb31 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:39.851429 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5b8340b2-e03f-47c4-a139-db779be7cb31 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1214 microversion: 2.1 time: 0.070014 Jun 23 11:56:39.852202 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 109/232] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:39 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1214 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:40.187556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:40.188165 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:40.194363 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:40.194813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:40.195622 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:40.195991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:40.329790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:40.337310 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-12aff5be-a3bc-4c30-a5c0-78cb91a09e8b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.153608 Jun 23 11:56:40.337880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 124/233] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:40 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:40.869519 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:40.870587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:40.877179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:40.877630 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:40.878400 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:40.878841 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:40.941845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:40.949985 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-13982639-d834-4313-9ef1-97f55194404c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1218 microversion: 2.1 time: 0.084594 Jun 23 11:56:40.950556 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 110/234] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:40 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:41.355239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:41.355850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:41.362019 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:41.362469 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:41.363266 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:41.364285 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:41.501003 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:41.508711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-093cd313-a794-4200-83f2-592faac8ede2 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.157923 Jun 23 11:56:41.509271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 125/235] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:41 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:41.966728 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:41.967352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:41.973902 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:41.974349 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:41.975111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:41.975540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:42.034228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:42.042075 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-011bf85d-923a-415c-8d7a-069abc3af748 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1218 microversion: 2.1 time: 0.078791 Jun 23 11:56:42.042649 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 111/236] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:41 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1218 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:42.525794 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:42.527180 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:42.529171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=66,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:42.534756 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:42.535208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:42.536168 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:42.536611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:42.706738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:42.716574 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a425c1fd-5ee3-4ee3-9128-615129ad540a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.194052 Jun 23 11:56:42.717216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 126/237] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:42 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:43.059850 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:43.060516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:43.067036 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:43.067484 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:43.068249 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:43.068691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:43.133023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:43.141460 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cc1d56f3-1624-481d-94ec-2b08e3718ad2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1210 microversion: 2.1 time: 0.086024 Jun 23 11:56:43.142032 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 112/238] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:43 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:43.733696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:43.734377 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:43.746291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:43.747292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:43.748239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:43.748855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:43.917436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:43.926954 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3a3573c0-5704-41c1-bbd8-8c860a9022a0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.197305 Jun 23 11:56:43.928983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 127/239] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:43 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:44.158221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:44.158857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:44.165314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.165933 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.166734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.167233 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.387407 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:44.396433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0cb0b8dd-840b-4fed-8d00-96cf2aaa1f97 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1272 microversion: 2.1 time: 0.242057 Jun 23 11:56:44.405999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 113/240] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:44 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1272 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:44.945362 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:44.945894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:44.952488 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.952961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:44.953709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:44.954134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:45.082304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:45.090470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ea2282e0-e58d-4da8-b12a-8bda3e78690e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.148995 Jun 23 11:56:45.091033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 128/241] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:44 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:45.413628 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:45.414224 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:45.421865 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:45.422460 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:45.423526 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:45.424076 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:45.568084 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:45.575461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e9d21498-036a-4b1a-a8d9-1d8a7c15d3c6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.165639 Jun 23 11:56:45.576013 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 114/242] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:45 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:46.106981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:46.107573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:46.113671 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:46.114116 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:46.114949 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:46.115382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:46.248298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:46.255827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-90da4cc8-7969-48d5-829e-381a316a43e7 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.152659 Jun 23 11:56:46.256390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 129/243] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:46 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:46.593250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:46.593777 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:46.596160 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=48 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:46.601897 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:46.602339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:46.603127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:46.603562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:46.735938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:46.743771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-689d95be-6e26-409f-b756-6957ef5c445a tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.155265 Jun 23 11:56:46.744351 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 115/244] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:46 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:47.271983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:47.272593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:47.279322 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:47.279762 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:47.280512 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:47.280957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:47.414820 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:47.423471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8ee31e1a-0f74-4f08-950c-f84c890a338e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.155378 Jun 23 11:56:47.424049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 130/245] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:47 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:47.762004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:47.762655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:47.769288 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:47.769741 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:47.770517 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:47.770953 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:48.010187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:48.017776 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0f48eb77-eda2-4efc-9dc0-f78e5ed82be7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.260284 Jun 23 11:56:48.018437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 116/246] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:47 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:48.440427 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:48.441071 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:48.447300 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:48.448841 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:48.449636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:48.450097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:48.591767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:48.599957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d60b8c93-2579-43b9-b79a-258bdbd97947 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.163283 Jun 23 11:56:48.600536 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 131/247] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:48 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:48.678734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-e5e457a5-f5f9-4e1e-88ee-51f29c88a39d req-9c5ff736-3910-4786-bc54-bf0f10051728 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "27c63240-b505-42de-a7ad-adce1d71686b", "tag": "f1b56c62-5182-41c6-b6f6-8b2aecba662b"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:56:48.688284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-e5e457a5-f5f9-4e1e-88ee-51f29c88a39d req-9c5ff736-3910-4786-bc54-bf0f10051728 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:48.688906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-e5e457a5-f5f9-4e1e-88ee-51f29c88a39d req-9c5ff736-3910-4786-bc54-bf0f10051728 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:48.702558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-e5e457a5-f5f9-4e1e-88ee-51f29c88a39d req-9c5ff736-3910-4786-bc54-bf0f10051728 service nova] Creating event network-changed:f1b56c62-5182-41c6-b6f6-8b2aecba662b for instance 27c63240-b505-42de-a7ad-adce1d71686b on hv-cinder-82660 Jun 23 11:56:48.707487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-e5e457a5-f5f9-4e1e-88ee-51f29c88a39d req-9c5ff736-3910-4786-bc54-bf0f10051728 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032450 Jun 23 11:56:48.708277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 117/248] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:56:49.035180 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:49.035789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:49.041840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.042288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.043084 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.043511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.208505 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:49.216153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-41deb37c-7714-4a0f-bb52-bef899d9f074 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.184782 Jun 23 11:56:49.216857 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 132/249] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:49 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:49.617830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:49.618630 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:49.626208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.626659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.627416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:49.627847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:49.756651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:49.764066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b53a5913-0222-4f3b-9acb-885a8c6713dd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.150486 Jun 23 11:56:49.764619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 118/250] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:49 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:50.235790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:50.236363 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:50.238033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:50.238677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=6 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:50.244284 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:50.245329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:50.246129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:50.246562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:50.521895 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:50.531067 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6ce5fa30-d132-472a-a63f-3e3a2d180521 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.300716 Jun 23 11:56:50.531932 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 133/251] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:50 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:50.781816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:50.782556 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:50.784542 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:50.790376 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:50.790826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:50.792181 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:50.792655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:50.949023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:50.956664 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ad5ce124-7824-4f0c-8f7c-0a77233f0b59 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.179250 Jun 23 11:56:50.957270 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 119/252] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:50 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:51.548803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:51.549444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:51.556058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:51.556591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:51.557493 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:51.558058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:51.705207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:51.719456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6e63ac89-2bea-4195-b48f-3957780bf10d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.174695 Jun 23 11:56:51.720184 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 134/253] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:51 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:56:51.974192 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:51.974876 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:51.984639 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:51.985343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:51.986137 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:51.986575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:52.134835 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:52.142921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-397c6c52-e2f9-477f-9f61-93bb855969fe tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.172496 Jun 23 11:56:52.143677 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 120/254] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:51 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:52.736753 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:52.737367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:52.743852 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:52.744298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:52.745675 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:52.746110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:52.761327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:52.886969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:52.894502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4c0a607e-06e0-48d4-b361-efcb9e0cd013 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.162088 Jun 23 11:56:52.895073 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 135/255] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:52 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:53.160649 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:53.161627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:53.169600 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.170328 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:53.171108 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.171713 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:53.442733 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:53.453295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d4f954e0-45bb-45d5-af25-8de483726ff3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.296166 Jun 23 11:56:53.454095 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 121/256] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:53 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:53.912821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:53.913437 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:53.919825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.920717 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:53.921499 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:53.921928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:54.061782 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:54.070197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-aeb81a1f-7270-4312-a255-e16f12784a6d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.161821 Jun 23 11:56:54.070879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 136/257] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:53 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:54.472661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:54.473230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:54.480284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:54.480852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:54.481690 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:54.482292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:54.699123 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:54.707028 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3d62fdde-4fae-48c4-a6e7-dab142df91eb tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.238438 Jun 23 11:56:54.707754 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 122/258] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:54 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:55.087351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:55.088072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:55.094426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:55.094885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:55.095649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:55.096157 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:55.248779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:55.258149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3ecaa0fb-7502-4b24-94fc-1a0a21f55c01 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.174630 Jun 23 11:56:55.258734 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 137/259] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:55 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:55.723618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:55.724223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:55.731155 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:55.731864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:55.732625 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:55.733099 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:55.863449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:55.871508 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8c8d56a0-93db-4024-89a1-b31fd9b1d12c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.151675 Jun 23 11:56:55.872072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 123/260] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:55 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:56.275264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:56.275946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:56.283049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:56.283579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:56.284436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:56.284983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:56.422389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:56.430231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8e21cff2-7a7b-4867-be80-222712b17068 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.158807 Jun 23 11:56:56.430805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 138/261] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:56 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:56.888962 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:56.889492 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:56.895940 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:56.896382 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:56.897166 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:56.897593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:56.912046 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:56:57.032001 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:57.040066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ac30262d-be9d-403e-9e26-0aaaf0bf2df9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.155634 Jun 23 11:56:57.040629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 124/262] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:56 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:57.447639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:57.448268 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:57.455047 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:57.455502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:57.456279 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:57.456733 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:57.600496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:57.608834 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-49d8cc46-fd21-4ebe-844d-1eaad81368de tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.165040 Jun 23 11:56:57.609449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 139/263] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:57 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:58.058360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:58.058912 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:58.065490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:58.065945 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:58.066712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:58.067146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:58.202408 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:58.210367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2bac6bb3-ccfc-4264-8f0f-ba98b8b2fd83 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.156583 Jun 23 11:56:58.210930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 125/264] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:58 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:58.625935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:58.626584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:58.633039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:58.633428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:58.634187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:58.634623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:58.762178 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:58.769560 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1f8f3f52-f0e0-41d6-aa3a-0005e061b7ea tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.147581 Jun 23 11:56:58.770122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 140/265] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:58 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:59.228409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:59.229032 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:59.235591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.236035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.236830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.237264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.362902 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:59.370414 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0288fec0-e22e-42db-b844-1339bae76f1d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.145884 Jun 23 11:56:59.370982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 126/266] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:59 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:56:59.786667 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:56:59.787277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:56:59.793496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.793948 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.794711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:56:59.795418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:56:59.928471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:56:59.936578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1c269978-f590-41d9-9d19-8f88e661a2c5 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.153749 Jun 23 11:56:59.937182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 141/267] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:56:59 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:00.386896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:00.387509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:00.394146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:00.394596 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:00.395362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:00.395799 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:00.529536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:00.536992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e046213e-a443-438f-b16f-a5e955172b97 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.153995 Jun 23 11:57:00.537552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 127/268] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:00 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:00.824546 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-ce05aed5-a1a7-4dfd-9280-6daf7dac00b7 req-65d9a3c5-b2a9-423c-a585-d31d3e3f203d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c63240-b505-42de-a7ad-adce1d71686b", "name": "network-vif-plugged", "status": "completed", "tag": "f1b56c62-5182-41c6-b6f6-8b2aecba662b"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:00.832825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ce05aed5-a1a7-4dfd-9280-6daf7dac00b7 req-65d9a3c5-b2a9-423c-a585-d31d3e3f203d service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:00.833265 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ce05aed5-a1a7-4dfd-9280-6daf7dac00b7 req-65d9a3c5-b2a9-423c-a585-d31d3e3f203d service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:00.845188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-ce05aed5-a1a7-4dfd-9280-6daf7dac00b7 req-65d9a3c5-b2a9-423c-a585-d31d3e3f203d service nova] Creating event network-vif-plugged:f1b56c62-5182-41c6-b6f6-8b2aecba662b for instance 27c63240-b505-42de-a7ad-adce1d71686b on hv-cinder-82660 Jun 23 11:57:00.850116 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-ce05aed5-a1a7-4dfd-9280-6daf7dac00b7 req-65d9a3c5-b2a9-423c-a585-d31d3e3f203d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029877 Jun 23 11:57:00.850862 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 142/269] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:00.954090 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:00.954785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:00.961198 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:00.961645 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:00.962443 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:00.962878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:01.097363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:01.105637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-aef4d8a8-6548-460b-8a12-1ca690c3b6df tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.155394 Jun 23 11:57:01.106216 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 128/270] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:00 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:01.555443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:01.556134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:01.562522 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:01.562972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:01.563740 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:01.564176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:01.706425 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:01.714880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3d50dc33-9ab5-44a1-8838-2875b3a3c30b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.163632 Jun 23 11:57:01.715478 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 143/271] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:01 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:02.123849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:02.124383 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:02.132125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:02.132571 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:02.133361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:02.133794 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:02.276952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:02.284501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cc86506f-fd4e-4096-b5cc-f73d572e74ac tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.165644 Jun 23 11:57:02.285116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 129/272] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:02 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:02.731884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:02.732497 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:02.738597 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:02.739045 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:02.739808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:02.740245 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:02.869040 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:02.876485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4c272a40-1fb0-41b4-b52e-f5206b756bc8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.149093 Jun 23 11:57:02.877091 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 144/273] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:02 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:03.302769 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:03.308078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:03.311647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:03.312162 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:03.313070 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:03.313525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:03.455680 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:03.463056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4ab0a2df-6688-40b0-a8fe-85926138e4a3 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.164894 Jun 23 11:57:03.463731 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 130/274] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:03 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:03.893419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:03.893948 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:03.899971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:03.900421 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:03.901222 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:03.901664 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:04.031023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:04.038585 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f129b447-b6c6-47c0-a121-167a31a9f55e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.149202 Jun 23 11:57:04.039153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 145/275] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:03 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:04.175690 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:04.176197 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:04.184930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:04.185384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:04.186164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:04.186599 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:04.312055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lazy-loading 'services' on Instance uuid a263d16c-8b58-4f38-8d81-6d2aec398219 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:04.428615 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3d931762-3baf-410f-98ab-16671efc3278 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219/os-volume_attachments/bd48806e-2a04-4ec0-bdeb-57cef804b4ef" status: 202 len: 0 microversion: 2.1 time: 0.258916 Jun 23 11:57:04.429324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 131/276] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 11:57:04 2022] DELETE /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219/os-volume_attachments/bd48806e-2a04-4ec0-bdeb-57cef804b4ef => generated 0 bytes in 260 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:57:04.481816 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:04.482429 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:04.491302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:04.491302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:04.491302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:04.491302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:04.629275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:04.637865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9ec59ca5-52c0-4007-ad91-b4436af28414 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1314 microversion: 2.1 time: 0.160720 Jun 23 11:57:04.638444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 146/277] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:04 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1314 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:05.060989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:05.061679 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:05.069665 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:05.071204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:05.072503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:05.073875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:05.245925 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:05.253650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-784cda46-3b3e-472f-ac01-b973961390c0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.197552 Jun 23 11:57:05.254245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 132/278] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:05 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:05.655393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:05.656821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:05.663328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:05.663943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:05.665167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:05.665933 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:05.814944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:05.824776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bfad7701-c56a-407e-b814-ba44ba62d668 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1498 microversion: 2.1 time: 0.173126 Jun 23 11:57:05.825629 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 147/279] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:05 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1498 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:06.272392 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:06.273066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:06.279899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.280433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.281317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.281815 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.387057 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:06.387554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:06.394434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.395079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.396458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.397641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.430796 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:57:06.507654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:06.521361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-808b9db9-2626-4aa3-bbea-8217bb5e111a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.252970 Jun 23 11:57:06.523402 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 133/280] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:06 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:06.556298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fd59ba1e-d9ad-4360-b643-f38d200de111 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "DELETE /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 204 len: 0 microversion: 2.1 time: 0.172784 Jun 23 11:57:06.557709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 148/281] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:57:06 2022] DELETE /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 0 bytes in 174 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:57:06.566087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:06.566589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:06.574608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.575057 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.575831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.576259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.621247 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:06.622104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:06.629393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.630192 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.631609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.632294 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.691487 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:57:06.741701 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:06.776780 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f0e11b47-0d38-4baa-99a7-f174f74d6a0f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "DELETE /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 204 len: 0 microversion: 2.1 time: 0.159427 Jun 23 11:57:06.777918 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 149/282] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:57:06 2022] DELETE /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:57:06.791087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:06.792272 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:06.800576 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.801084 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.801906 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:06.802299 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:06.810260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:06.818637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-79c7076b-41a3-4352-ac64-dbfc2322655d tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1504 microversion: 2.1 time: 0.256572 Jun 23 11:57:06.819229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 134/283] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:06 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1504 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:06.962791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:06.972351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2cf0f23d-07e6-430b-bc50-939dd800ee0e tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1560 microversion: 2.1 time: 0.186068 Jun 23 11:57:06.972824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 150/284] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:06 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1560 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:07.539342 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:07.540095 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:07.551285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:07.551718 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:07.552625 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:07.553093 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:07.719434 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:07.734270 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-045b27a9-0690-4e3b-9bc5-0919804e817b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.198689 Jun 23 11:57:07.734945 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 135/285] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:07 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:07.836731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:07.837690 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:07.847312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:07.847850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:07.849065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:07.849612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:07.990264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:07.990868 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:07.999574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.000035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.000860 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.001292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.005580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:08.015569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-62249f6f-67eb-4dc2-9383-598c9b79a147 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1504 microversion: 2.1 time: 0.182559 Jun 23 11:57:08.016271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 151/286] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:07 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1504 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:08.140597 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:08.148479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fc6cef05-ee7f-453e-895e-14dd5d5661fd tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1560 microversion: 2.1 time: 0.162974 Jun 23 11:57:08.149073 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 136/287] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:07 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1560 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:08.751022 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:08.751629 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:08.757661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.758106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.758859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.759288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.905304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:08.912928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f6eb4418-e78e-48a4-a5a2-7e2503af289a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1502 microversion: 2.1 time: 0.165635 Jun 23 11:57:08.913497 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 152/288] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:08 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1502 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:08.930120 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "3716181d-f455-4449-aaf5-079d87ef6dd9"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:08.931328 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:08.937968 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.938417 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.939183 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.939620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.962698 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] HTTP exception thrown: Cannot 'attach_volume' instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 while it is in vm_state rescued Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Request method failure captured: Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: POST /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50/os-volume_attachments HTTP/1.1 Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 74 Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSKAAp6qrKeaawTlKefza8FWjHIgItwm35jOuhUXipytjbbMDMJWgWnmVArHcbPZtNrKA4QL87Xmh6HJ89-FiqVjANRs4es7oVQEf9mhxpXOQVOOcMEpy2R0T0Uos278lOZ963Zn_zVlv68QVt1ZGwtNRgH6-xVoOO6N3NX_1DBySM Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:57:08.965060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 53f1188f2446493baae7dc79bbb66ff7 Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {"volumeAttachment": {"volumeId": "3716181d-f455-4449-aaf5-079d87ef6dd9"}} Jun 23 11:57:08.966574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Cannot 'attach_volume' instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 while it is in vm_state rescued Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'server_id': 'e63e29e5-ecda-4f38-a06f-ba4d2cf35e50', 'body': {'volumeAttachment': {'volumeId': '3716181d-f455-4449-aaf5-079d87ef6dd9'}}} Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:57:08.967708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 while it is in vm_state rescued Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:08.969226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:08.970537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:57:08.970537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:57:08.970537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 while it is in vm_state rescued Jun 23 11:57:08.970537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:08.970537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Returning 409 to user: Cannot 'attach_volume' instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 while it is in vm_state rescued {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:57:08.970537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2739a984-3ec9-427d-a41e-7b0afdf0cd32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.040411 Jun 23 11:57:08.970537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 137/289] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:57:08 2022] POST /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50/os-volume_attachments => generated 152 bytes in 42 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 11:57:08.975580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4f6ff12a-297c-4fe1-a3ba-406c4c451280 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:08.976111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4f6ff12a-297c-4fe1-a3ba-406c4c451280 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:08.982261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f6ff12a-297c-4fe1-a3ba-406c4c451280 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.982703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f6ff12a-297c-4fe1-a3ba-406c4c451280 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:08.983456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f6ff12a-297c-4fe1-a3ba-406c4c451280 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:08.983885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f6ff12a-297c-4fe1-a3ba-406c4c451280 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:09.033608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:09.034220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:09.040503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:09.041027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:09.041834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:09.042384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:09.050598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4f6ff12a-297c-4fe1-a3ba-406c4c451280 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50/action" status: 202 len: 0 microversion: 2.1 time: 0.078748 Jun 23 11:57:09.051382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 153/290] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:57:08 2022] POST /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50/action => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:57:09.059895 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:09.060587 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:09.066999 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:09.067445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:09.068214 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:09.068649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:09.182921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:09.190830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2138cded-bbd1-4feb-bd97-68846909037e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1504 microversion: 2.1 time: 0.161065 Jun 23 11:57:09.196782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 138/291] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:09 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1504 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:09.196782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:09.196782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:09.203277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:09.203727 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:09.204630 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:09.205003 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:09.207863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:09.216492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1f6a90f7-913d-4ade-88c7-1bf0114faa13 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.160686 Jun 23 11:57:09.220718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 154/292] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:09 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:09.341360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:09.348858 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6bedef9c-b452-401b-8064-a3fd06c2f0ad tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1514 microversion: 2.1 time: 0.156296 Jun 23 11:57:09.349506 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 139/293] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:09 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1514 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:10.208689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:10.209723 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:10.217774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.219201 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.220327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.220984 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.234859 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:10.235685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:10.244317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.245106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.246204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.246881 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.410422 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:10.412879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:10.417594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:10.424653 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a33ce4c3-9c54-465c-94bb-fe4bd0ec069e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.193109 Jun 23 11:57:10.425838 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 140/294] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:10 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:10.435472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-94c59111-ed06-4596-95b0-3b0d7b1a321e tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1504 microversion: 2.1 time: 0.223844 Jun 23 11:57:10.435472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 155/295] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:10 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1504 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:10.447259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:10.449356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:10.455767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.456612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.457728 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:10.458170 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:10.600049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:10.607775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-60a99883-f93b-415e-9c8f-f2cac49c463f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1514 microversion: 2.1 time: 0.172759 Jun 23 11:57:10.608349 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 156/296] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:10 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1514 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:11.443487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:11.445085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:11.446727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:11.448243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:11.453708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.454163 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.455096 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.458393 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.458676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.458676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.458676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.458676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.666532 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:11.708584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d6953304-6c99-4f6b-95f8-7a6ae268325f tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1504 microversion: 2.1 time: 0.267473 Jun 23 11:57:11.711529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 157/297] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:11 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1504 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:11.723532 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:11.724188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:11.739422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.741844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.743651 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.744105 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.860562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:11.869023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c8b26a63-bccc-48a5-a810-ac92e71edb3c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.430287 Jun 23 11:57:11.870162 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 141/298] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:11 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:11.884244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-c3fe064f-f9d0-4ed5-bb61-3d3d966b63bc req-916d465f-6bb3-4b65-9d39-d672a687624a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c63240-b505-42de-a7ad-adce1d71686b", "name": "network-vif-unplugged", "status": "completed", "tag": "f1b56c62-5182-41c6-b6f6-8b2aecba662b"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:11.906560 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c3fe064f-f9d0-4ed5-bb61-3d3d966b63bc req-916d465f-6bb3-4b65-9d39-d672a687624a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:11.907199 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c3fe064f-f9d0-4ed5-bb61-3d3d966b63bc req-916d465f-6bb3-4b65-9d39-d672a687624a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:11.933199 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-c3fe064f-f9d0-4ed5-bb61-3d3d966b63bc req-916d465f-6bb3-4b65-9d39-d672a687624a service nova] Creating event network-vif-unplugged:f1b56c62-5182-41c6-b6f6-8b2aecba662b for instance 27c63240-b505-42de-a7ad-adce1d71686b on hv-cinder-82660 Jun 23 11:57:11.944278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-c3fe064f-f9d0-4ed5-bb61-3d3d966b63bc req-916d465f-6bb3-4b65-9d39-d672a687624a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.063706 Jun 23 11:57:11.949455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 142/299] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:57:12.030000 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:12.075195 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d03f0a23-6b4c-406f-9e77-237f969c8c4f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1514 microversion: 2.1 time: 0.361524 Jun 23 11:57:12.075582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 158/300] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:11 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1514 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:12.735097 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:12.736053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:12.746044 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:12.746875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:12.748023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:12.748696 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:12.887661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:12.889053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:12.894738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=76,nova_api:UPDATE=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:12.896930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:12.898693 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:12.899764 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:12.901389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:13.121149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:13.128969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-77356dcd-d9ae-4fd5-a843-ebb882a9a865 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.246060 Jun 23 11:57:13.129550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 159/301] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:12 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:13.134518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:13.135184 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:13.141987 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:13.142434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:13.143234 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:13.143957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:13.191621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:13.201134 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-268faf10-cc5e-4ed2-809b-7de42d821be6 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1504 microversion: 2.1 time: 0.472399 Jun 23 11:57:13.201713 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 143/302] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:12 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1504 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:13.206790 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-192432e3-8cd8-4070-bb25-9b4852985bb6 req-1f0f6e8a-2d02-4acf-8c4d-22e7c9726d99 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "27c63240-b505-42de-a7ad-adce1d71686b", "name": "network-vif-deleted", "tag": "f1b56c62-5182-41c6-b6f6-8b2aecba662b"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:13.216503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-192432e3-8cd8-4070-bb25-9b4852985bb6 req-1f0f6e8a-2d02-4acf-8c4d-22e7c9726d99 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:13.216943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-192432e3-8cd8-4070-bb25-9b4852985bb6 req-1f0f6e8a-2d02-4acf-8c4d-22e7c9726d99 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:13.229871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-192432e3-8cd8-4070-bb25-9b4852985bb6 req-1f0f6e8a-2d02-4acf-8c4d-22e7c9726d99 service nova] Creating event network-vif-deleted:f1b56c62-5182-41c6-b6f6-8b2aecba662b for instance 27c63240-b505-42de-a7ad-adce1d71686b on hv-cinder-82660 Jun 23 11:57:13.231498 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:13.237091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-192432e3-8cd8-4070-bb25-9b4852985bb6 req-1f0f6e8a-2d02-4acf-8c4d-22e7c9726d99 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033568 Jun 23 11:57:13.237937 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 144/303] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:13.239880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bd84ef86-b2eb-4889-ba01-41e51df7b0f1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1472 microversion: 2.1 time: 0.108990 Jun 23 11:57:13.240329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 160/304] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:13 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1472 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:14.146811 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:14.147731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:14.154232 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.154712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.155449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.155884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.219258 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:14.219968 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:14.227324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.227997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.228995 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.229436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.265301 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.265895 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.266444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lazy-loading 'fault' on Instance uuid 27c63240-b505-42de-a7ad-adce1d71686b {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:14.303673 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:14.311790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c31e8931-0187-4df1-b288-fb5c6371363b tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.168937 Jun 23 11:57:14.315622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:14.321202 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 161/305] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:14 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:14.327330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:14.327946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:14.328485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7b33f70c-26bd-474f-bf03-244992ffa0fa tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1304 microversion: 2.1 time: 0.113160 Jun 23 11:57:14.337999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 145/306] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:14 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1304 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:14.338899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.338899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.338899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.338899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.370352 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.370797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.371430 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lazy-loading 'fault' on Instance uuid a263d16c-8b58-4f38-8d81-6d2aec398219 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:14.424564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:14.434074 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a663a1a9-a379-4290-9cb6-936cfd4aaa0b tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1309 microversion: 2.1 time: 0.111380 Jun 23 11:57:14.434674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 162/307] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:14 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1309 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:14.719670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-969f3852-cded-428a-8f66-71e5c35d7c38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:14.720167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-969f3852-cded-428a-8f66-71e5c35d7c38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:14.726272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-969f3852-cded-428a-8f66-71e5c35d7c38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.726717 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-969f3852-cded-428a-8f66-71e5c35d7c38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.727476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-969f3852-cded-428a-8f66-71e5c35d7c38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:14.727910 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-969f3852-cded-428a-8f66-71e5c35d7c38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:14.750551 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-969f3852-cded-428a-8f66-71e5c35d7c38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/ips" status: 200 len: 151 microversion: 2.20 time: 0.034757 Jun 23 11:57:14.751113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 146/308] 10.222.0.67 () {60 vars in 1288 bytes} [Thu Jun 23 11:57:14 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/ips => generated 151 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 11:57:15.252548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-0916e91b-7d31-4421-b416-bd516aceae95 req-44189c82-d167-4118-b4af-32a3ed0f60a3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a263d16c-8b58-4f38-8d81-6d2aec398219", "name": "network-vif-deleted", "tag": "2c7047e7-2534-4b9b-aace-b311d43e694f"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:15.261423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-0916e91b-7d31-4421-b416-bd516aceae95 req-44189c82-d167-4118-b4af-32a3ed0f60a3 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.261863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-0916e91b-7d31-4421-b416-bd516aceae95 req-44189c82-d167-4118-b4af-32a3ed0f60a3 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.272562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-0916e91b-7d31-4421-b416-bd516aceae95 req-44189c82-d167-4118-b4af-32a3ed0f60a3 service nova] Creating event network-vif-deleted:2c7047e7-2534-4b9b-aace-b311d43e694f for instance a263d16c-8b58-4f38-8d81-6d2aec398219 on hv-cinder-82660 Jun 23 11:57:15.278243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-0916e91b-7d31-4421-b416-bd516aceae95 req-44189c82-d167-4118-b4af-32a3ed0f60a3 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029628 Jun 23 11:57:15.278803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 163/309] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:15.329013 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:15.329602 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:15.336116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.336559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.337348 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.337771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.346259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:15.347106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:15.353432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.353880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.354651 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.355087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.387229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.387676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.388127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lazy-loading 'fault' on Instance uuid 27c63240-b505-42de-a7ad-adce1d71686b {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:15.428581 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:15.436763 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6d781fc0-8682-4b62-bd40-afce73f158e7 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1304 microversion: 2.1 time: 0.094800 Jun 23 11:57:15.437345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 164/310] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:15 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1304 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:15.451660 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:15.452379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:15.458761 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.459292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.460135 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.460577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.469469 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:15.473107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:15.481369 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-61f39376-3814-4f92-b391-2dd02dbfef4a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.156208 Jun 23 11:57:15.482514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 147/311] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:15 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:15.499481 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:15.499811 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:15.500258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lazy-loading 'fault' on Instance uuid a263d16c-8b58-4f38-8d81-6d2aec398219 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:15.545713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:15.553539 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-479d8d89-abc0-45b6-9869-1167d332bd18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1309 microversion: 2.1 time: 0.106194 Jun 23 11:57:15.554197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 165/312] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:15 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1309 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:16.453409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:16.454019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:16.460564 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.461046 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.461811 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.462248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.493615 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.494053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.494504 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lazy-loading 'fault' on Instance uuid 27c63240-b505-42de-a7ad-adce1d71686b {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:16.499834 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:16.500565 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:16.506773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.507211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.508101 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.508528 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.544361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:16.559719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4b594836-e6f9-44a7-8224-0309b80d40ec tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1304 microversion: 2.1 time: 0.109996 Jun 23 11:57:16.560762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 148/313] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:16 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1304 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:16.573479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:16.574105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:16.581127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.581585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.582408 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.582843 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.611485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=74 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:16.616264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:16.616743 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:16.617196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lazy-loading 'fault' on Instance uuid a263d16c-8b58-4f38-8d81-6d2aec398219 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:16.643251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:16.651572 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f572437c-bd39-43f2-a8ce-9e16411030ef tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.156741 Jun 23 11:57:16.652146 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 166/314] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:16 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:16.660739 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:16.669378 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ecd605cc-5420-49b6-a36d-266016b148de tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1309 microversion: 2.1 time: 0.101627 Jun 23 11:57:16.670573 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 149/315] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:16 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1309 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:17.579939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:17.580577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:17.589554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.589910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.590770 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.591127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.626517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.627010 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.627462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lazy-loading 'fault' on Instance uuid 27c63240-b505-42de-a7ad-adce1d71686b {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:17.669672 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:17.670659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:17.702119 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.702961 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.704138 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.704927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.730107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '23a9ad25030045b9b5dad89eadca1b9c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd4f7063c9ea64b569c3699a45ad0bb2e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:17.747597 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c2cc2af4-7c02-489e-ac3c-3a8244ae7c5c tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 200 len: 1304 microversion: 2.1 time: 0.173774 Jun 23 11:57:17.748439 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 167/316] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:17 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 1304 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:17.758774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:17.760274 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:17.783055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.783804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.785208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.785971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.849133 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:17.849653 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:17.850226 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lazy-loading 'fault' on Instance uuid a263d16c-8b58-4f38-8d81-6d2aec398219 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:17.911741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:17.921257 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-37b00e14-2184-4882-a7af-6d2085e2a8c1 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 200 len: 1309 microversion: 2.1 time: 0.171472 Jun 23 11:57:17.922153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 168/317] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:17 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 1309 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:18.209504 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:18.218688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-743f9bbf-43cf-4969-959f-ba748a4efc43 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1510 microversion: 2.1 time: 0.553986 Jun 23 11:57:18.219305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 150/318] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:17 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1510 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:18.631282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:18.632186 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:18.645893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.646893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.648245 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.649273 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.686698 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lazy-loading 'flavor' on Instance uuid e19ec4d3-4ce1-4fbd-81ea-025a5c724421 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:57:18.775275 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:18.776265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] [instance: 27c63240-b505-42de-a7ad-adce1d71686b] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:18.783201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.783674 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.784481 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.784938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.802852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] HTTP exception thrown: Instance 27c63240-b505-42de-a7ad-adce1d71686b could not be found. Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Request method failure captured: Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b HTTP/1.1 Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFTOTTzHlYGLVCMtp5i5Fi7K-q9an3_QEAIeexHq2_MBinqeb5RkY0jAN7Aw9M2opiBRQG1gT-VDZGrbaLaWwh9QzDRRd2DWw5pSFVxpoOzI1G2QdKsMkNcYGJJDu9ynDrF8f3gg6Lfel9SWtzzTK_o8oj66c4OW8I3TCUmlAR7yTj4 Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: d4f7063c9ea64b569c3699a45ad0bb2e Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesActionsTest-1023231657 Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:57:18.804500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d4f7063c9ea64b569c3699a45ad0bb2e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesActionsTest-1023231657 Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: d4f7063c9ea64b569c3699a45ad0bb2e Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesActionsTest-1023231657 Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesActionsTest-1023231657-project Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 23a9ad25030045b9b5dad89eadca1b9c Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesActionsTest-1023231657-project Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 27c63240-b505-42de-a7ad-adce1d71686b could not be found. Jun 23 11:57:18.805989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '27c63240-b505-42de-a7ad-adce1d71686b'} Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 27c63240-b505-42de-a7ad-adce1d71686b could not be found. Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:57:18.806842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 27c63240-b505-42de-a7ad-adce1d71686b could not be found. Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 27c63240-b505-42de-a7ad-adce1d71686b could not be found. Jun 23 11:57:18.808752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:18.810401 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] Returning 404 to user: Instance 27c63240-b505-42de-a7ad-adce1d71686b could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:57:18.810401 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-018ba31f-4630-4903-9d3e-787907a326c2 tempest-VolumesActionsTest-1023231657 tempest-VolumesActionsTest-1023231657-project] 10.222.0.67 "GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b" status: 404 len: 111 microversion: 2.1 time: 0.037726 Jun 23 11:57:18.820765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 151/319] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:18 2022] GET /compute/v2.1/servers/27c63240-b505-42de-a7ad-adce1d71686b => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:57:18.946415 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:18.947779 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: a263d16c-8b58-4f38-8d81-6d2aec398219] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:18.960079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.961399 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.963074 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:18.963901 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:18.990856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] HTTP exception thrown: Instance a263d16c-8b58-4f38-8d81-6d2aec398219 could not be found. Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Request method failure captured: Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 HTTP/1.1 Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFS0QfscGNCst6m-gsWVXNzNXdN0JNoyrUXwuuHZ80Be7nApGrjhgUSxGPGWLpJNZoD_cF6rP2nE4Qqd_p3gAkoqEweBvioIkMRJcYwo-Il04-oeeILx7Wbxj9uNe1ZZGdn1WM1r-rZfuEs3RksFjtVXwOrc5qzRPfUZKirTaxvAKQ0 Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: a5a0086895b6442da90bc0f1bcecd3e7 Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesSnapshotTestJSON-81888496 Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:57:18.998068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesSnapshotTestJSON-81888496 Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: a5a0086895b6442da90bc0f1bcecd3e7 Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-81888496 Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesSnapshotTestJSON-81888496-project Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: f7cf8ed5de4b41b19b6f25299087e1b5 Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesSnapshotTestJSON-81888496-project Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance a263d16c-8b58-4f38-8d81-6d2aec398219 could not be found. Jun 23 11:57:19.000439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'a263d16c-8b58-4f38-8d81-6d2aec398219'} Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a263d16c-8b58-4f38-8d81-6d2aec398219 could not be found. Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:57:19.001485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a263d16c-8b58-4f38-8d81-6d2aec398219 could not be found. Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a263d16c-8b58-4f38-8d81-6d2aec398219 could not be found. Jun 23 11:57:19.003324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:57:19.004514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Returning 404 to user: Instance a263d16c-8b58-4f38-8d81-6d2aec398219 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:57:19.004514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-48898703-5185-4a99-9c70-3ec4e96289d8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219" status: 404 len: 111 microversion: 2.1 time: 0.065981 Jun 23 11:57:19.004514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 152/320] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:18 2022] GET /compute/v2.1/servers/a263d16c-8b58-4f38-8d81-6d2aec398219 => generated 111 bytes in 68 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:57:19.032330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-893eec01-33be-4be2-b543-75b5e9167268 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/action" status: 202 len: 0 microversion: 2.20 time: 0.404672 Jun 23 11:57:19.032330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 169/321] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 23 11:57:18 2022] POST /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/action => generated 0 bytes in 408 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:57:19.042006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:19.042768 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:19.052338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.053288 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.054687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.055555 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.239310 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:19.240282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:19.248755 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.249394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.250372 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.250943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.306027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:19.321010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:19.324082 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:19.326036 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c7887666-c1c4-4551-a5be-e84d03e8f1d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.289944 Jun 23 11:57:19.346056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 153/322] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:19 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:19.557712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:19.574495 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8384e277-2a28-4a6a-8338-4bcfeae21e32 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1516 microversion: 2.1 time: 0.340881 Jun 23 11:57:19.577077 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 170/323] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:19 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1516 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:19.898727 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e409abff-768e-47df-b1e7-e54c784e1be3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:19.899762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e409abff-768e-47df-b1e7-e54c784e1be3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:19.911891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e409abff-768e-47df-b1e7-e54c784e1be3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.912593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e409abff-768e-47df-b1e7-e54c784e1be3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.914222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e409abff-768e-47df-b1e7-e54c784e1be3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:19.915127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e409abff-768e-47df-b1e7-e54c784e1be3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:19.964581 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e409abff-768e-47df-b1e7-e54c784e1be3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/ips" status: 200 len: 145 microversion: 2.1 time: 0.075690 Jun 23 11:57:19.974641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 154/324] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 11:57:19 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/ips => generated 145 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:20.351398 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:20.352099 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:20.358745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:20.359252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:20.359925 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:20.360347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:20.546979 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:20.556775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:20.558367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:20.559557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-71f35c00-0060-4ee1-9a04-52e9b5521d80 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.212024 Jun 23 11:57:20.560289 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 171/325] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:20 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:57:21.418949 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d6e0a0ad-4a70-4ca0-acfd-177c3c338f25 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:21.420222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d6e0a0ad-4a70-4ca0-acfd-177c3c338f25 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:21.427958 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6e0a0ad-4a70-4ca0-acfd-177c3c338f25 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:21.428567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6e0a0ad-4a70-4ca0-acfd-177c3c338f25 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:21.429537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6e0a0ad-4a70-4ca0-acfd-177c3c338f25 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:21.430132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6e0a0ad-4a70-4ca0-acfd-177c3c338f25 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:21.474456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d6e0a0ad-4a70-4ca0-acfd-177c3c338f25 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/ips" status: 200 len: 149 microversion: 2.1 time: 0.059386 Jun 23 11:57:21.477164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 155/326] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 11:57:21 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/ips => generated 149 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:57:21.586431 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:21.587214 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:21.596213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:21.596666 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:21.597490 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:21.597921 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:21.820908 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:21.830837 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:21.833110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:21.834129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e18afdf2-25ee-412a-86a3-3d20bb50eee5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.255487 Jun 23 11:57:21.834689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 172/327] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:21 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:22.857814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:22.858740 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:22.868328 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:22.868809 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:22.869660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:22.870088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:23.101059 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:23.123900 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:23.126118 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:23.127506 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-43e1a0b8-2d63-4bfe-9c7f-178ae928b92d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.276999 Jun 23 11:57:23.128724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 156/328] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:22 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:23.243888 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a86d4702-f1ad-481d-83cc-a2ce9dda974d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'create', calling method: .version_select at 0x7f3ae60c1af0>, body: {"keypair": {"name": "tempest-keypair-435055559", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPIXqqk9vnfKVOfT1UEQht7+kBaYXHZXJbOs7BdL4ogI03N27QynJwNJzGVPpq+w7zu3uN/v2rC5TxkKTWc5XasSDZW42gQFG6+JYIqFYh2mqMGbVACojwW+GoNCkdUNqA=="}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:23.263515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-a86d4702-f1ad-481d-83cc-a2ce9dda974d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'key_pairs'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:57:23.272813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-a86d4702-f1ad-481d-83cc-a2ce9dda974d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for user 53f1188f2446493baae7dc79bbb66ff7 and project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'key_pairs'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:57:23.307222 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a86d4702-f1ad-481d-83cc-a2ce9dda974d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.067415 Jun 23 11:57:23.308020 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 173/329] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 11:57:23 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:24.151337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:24.151948 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:24.163880 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:24.164328 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:24.165139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:24.165572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:24.482685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:24.500108 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:24.508142 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:24.509498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-306c5f36-ee7a-46c0-a253-508ffbee332f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.366240 Jun 23 11:57:24.510123 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 157/330] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:24 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 368 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:25.530936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:25.530936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:25.540887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:25.541888 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:25.542705 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:25.543154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:25.584310 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-727243902", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "fc58067c-4167-4106-9d1e-ab7bc831a394"}], "security_groups": [{"name": "tempest-securitygroup--691288781"}], "key_name": "tempest-keypair-435055559", "user_data": "}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:25.791072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:25.807602 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:25.811231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:25.815928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2b2e4ba1-1d49-4296-8834-18d483d63228 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.289519 Jun 23 11:57:25.829975 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 174/331] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:25 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:25.830236 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] validate_networks() for [('fc58067c-4167-4106-9d1e-ab7bc831a394', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:57:26.412487 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e45d381e-bfc8-48e6-a8fa-7d5ae436676b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e59c50bb-57a9-43e8-ad0d-2176411fe943"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:26.414532 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e45d381e-bfc8-48e6-a8fa-7d5ae436676b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:26.423682 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e45d381e-bfc8-48e6-a8fa-7d5ae436676b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:26.424424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e45d381e-bfc8-48e6-a8fa-7d5ae436676b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:26.425245 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e45d381e-bfc8-48e6-a8fa-7d5ae436676b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:26.425684 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e45d381e-bfc8-48e6-a8fa-7d5ae436676b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:26.892227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e45d381e-bfc8-48e6-a8fa-7d5ae436676b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.485674 Jun 23 11:57:26.893874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 175/332] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:57:26 2022] POST /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments => generated 194 bytes in 489 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:57:26.912096 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:26.912876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:26.924328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:26.925063 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:26.926357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:26.927621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.066735 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:57:27.067289 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:57:27.068195 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:57:27.068889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:57:27.069803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:57:27.093872 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.095823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.097325 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.099527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.161759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:27.173931 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:27.176283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:27.178393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7f99452e-11dc-4425-824d-f989bb1b774d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.282561 Jun 23 11:57:27.179163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 176/333] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:26 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:27.186328 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:57:27.198905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Getting quotas for user 53f1188f2446493baae7dc79bbb66ff7 and project 9353d04a04ab44e58f56fd01ca43d62e. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:57:27.227471 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:57:27.231711 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:57:27.299136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6efee3ac-0b82-4a37-82a5-103d00d54476 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 1.722566 Jun 23 11:57:27.300524 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 158/334] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:57:25 2022] POST /compute/v2.1/servers => generated 408 bytes in 1725 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:57:27.311002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c281ce3b-e520-4cf4-b095-ba73db957f42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:27.311819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c281ce3b-e520-4cf4-b095-ba73db957f42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:27.451526 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c281ce3b-e520-4cf4-b095-ba73db957f42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:27.459993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c281ce3b-e520-4cf4-b095-ba73db957f42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1244 microversion: 2.1 time: 0.153521 Jun 23 11:57:27.461122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 177/335] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:27 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1244 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:27.565824 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bb99ec45-867a-4638-a194-760fa3eed08c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "62d3bae1-437a-42c9-bf80-0d0d0aeac4b8"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:27.567209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bb99ec45-867a-4638-a194-760fa3eed08c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:27.578209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb99ec45-867a-4638-a194-760fa3eed08c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.578849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb99ec45-867a-4638-a194-760fa3eed08c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:27.579643 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb99ec45-867a-4638-a194-760fa3eed08c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:27.580089 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb99ec45-867a-4638-a194-760fa3eed08c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:28.201330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:28.202035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:28.222280 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:28.223091 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:28.224968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:28.225691 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:28.436093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:28.453414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:28.455598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:28.460233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f2a3f29d-043b-4a67-b927-fe7fd12e9f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.263877 Jun 23 11:57:28.462283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 178/336] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:28 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:57:28.479796 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:28.480417 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:28.503835 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:28.506627 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:28.508625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:28.510725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:28.550204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:28.677303 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:28.689965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-42463176-aacd-4829-9871-310eaecd09e4 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1248 microversion: 2.1 time: 0.213840 Jun 23 11:57:28.691969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 179/337] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:28 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1248 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:29.483279 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:29.485725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:29.499657 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:29.500097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:29.504497 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:29.506682 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:29.833752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:29.844967 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:29.847486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:29.849191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0f314fe3-4a06-4afa-8bae-0edbbb1a91fe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.372462 Jun 23 11:57:29.850224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 180/338] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:29 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:29.856403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:29.857355 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:29.868007 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:29.868768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:29.869736 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:29.870304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:29.987509 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:30.001972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9a667b5e-c592-4c98-99a5-caf2d5186dc0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1248 microversion: 2.1 time: 0.150219 Jun 23 11:57:30.003936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 181/339] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:29 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1248 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:30.693208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:30.752104 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bb99ec45-867a-4638-a194-760fa3eed08c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.192112 Jun 23 11:57:30.758399 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 159/340] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:57:27 2022] POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-volume_attachments => generated 194 bytes in 3200 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:30.872741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:30.874616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:30.883149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:30.883929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:30.885568 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:30.886168 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:31.027202 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:31.028275 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:31.040540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:31.045075 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:31.047595 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:31.048868 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:31.140606 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:31.157942 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:31.160606 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:31.162217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2fced301-3124-4de6-a7c4-1f1cd1c6042c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.294090 Jun 23 11:57:31.163718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 182/341] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:30 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:31.170691 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1807323278", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "networks": [{"uuid": "1cbb7bc8-91c5-4257-ad30-f56ed02325b3"}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:31.255838 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] validate_networks() for [('1cbb7bc8-91c5-4257-ad30-f56ed02325b3', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:57:31.329922 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:31.343888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bbc53a76-dd7f-445f-99f0-af8788ca5203 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1296 microversion: 2.1 time: 0.321954 Jun 23 11:57:31.348725 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 160/342] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:31 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1296 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:31.923325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:57:31.924928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:57:31.925904 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:57:31.926513 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:57:31.927155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:57:31.942606 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:31.943436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:31.944638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:31.945279 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:31.977357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Getting quotas for project a5a0086895b6442da90bc0f1bcecd3e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:57:31.985590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Getting quotas for user f7cf8ed5de4b41b19b6f25299087e1b5 and project a5a0086895b6442da90bc0f1bcecd3e7. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:57:32.010029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:57:32.012886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:57:32.100243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-efb62620-17b7-49ea-a792-ab9f1bf3cf73 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.934724 Jun 23 11:57:32.106729 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 183/343] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:57:31 2022] POST /compute/v2.1/servers => generated 380 bytes in 942 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:57:32.112260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aa535779-6de3-45da-81bc-a2f9e5d54b99 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:32.113268 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-aa535779-6de3-45da-81bc-a2f9e5d54b99 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:32.186410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:32.187589 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:32.214426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:32.215203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:32.216600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:32.217389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:32.330651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-aa535779-6de3-45da-81bc-a2f9e5d54b99 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:32.341330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-aa535779-6de3-45da-81bc-a2f9e5d54b99 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1219 microversion: 2.1 time: 0.233536 Jun 23 11:57:32.357837 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 161/344] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:32 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1219 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:32.376855 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:32.377784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:32.390185 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:32.391081 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:32.392040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:32.397234 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:32.602255 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:32.616168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1d5b430d-ac4e-4725-98e0-b81d926f7677 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1302 microversion: 2.1 time: 0.252749 Jun 23 11:57:32.618552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 162/345] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:32 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1302 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:32.923872 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:32.945553 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:32.951353 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:32.952731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1c098e16-cc28-4937-9044-f48a47b5f8e6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.774519 Jun 23 11:57:32.953294 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 184/346] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:32 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 776 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:57:33.387726 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:33.389618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:33.400825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:33.405160 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:33.406017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:33.406432 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:33.565549 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:33.579759 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0d0f58b6-7571-465d-b696-8a73b737ec07 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1223 microversion: 2.1 time: 0.196580 Jun 23 11:57:33.585315 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 163/347] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:33 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1223 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:33.636562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:33.637220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:33.661494 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:33.667495 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:33.668514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:33.668996 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:33.972330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:33.973378 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:33.993150 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:33.993723 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:33.999313 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:34.003495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:34.878189 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:34.913943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fa75c0ee-9035-450d-ba3b-3a89db214fc9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 1.278656 Jun 23 11:57:34.930067 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 185/348] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:33 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 1299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:34.947980 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:34.949870 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:34.989060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:34.990390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:34.999022 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:35.000166 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:35.017726 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:35.089666 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:35.101439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:35.102703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1b1c7658-5e24-42d0-bb2a-d69a26cc1445 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 1.135266 Jun 23 11:57:35.103281 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 164/349] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:33 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:35.238374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9bf1a0dc-4dda-48cc-995a-81fb0ffeaf05 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: .version_select at 0x7f3ae62385e0>, body: {"keypair": {"name": "tempest-keypair-707672602", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDw71cBMiwRsfSFL1eAuWqOq9dnq0hBlUF3JtDWkwVCwnCbfmxIiaboVxN7ZUIECyFKMYKc2Lw+NaVIGkG2TWSr8sP1sJdlr4S1ZVgUo3xQUaaRnlaaCrSmz4Bh99Qq/ag=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:35.329381 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-9bf1a0dc-4dda-48cc-995a-81fb0ffeaf05 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:57:35.341033 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-9bf1a0dc-4dda-48cc-995a-81fb0ffeaf05 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:57:35.474095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:35.510883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9bf1a0dc-4dda-48cc-995a-81fb0ffeaf05 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.266322 Jun 23 11:57:35.512802 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 165/350] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 11:57:35 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:35.517367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-549eda0d-5e4b-4f6a-8ab7-3c491a68702a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1289 microversion: 2.1 time: 0.572263 Jun 23 11:57:35.518752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 186/351] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:34 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1289 bytes in 588 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:35.949068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:35.965684 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:35.991280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:35.992507 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:35.994874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:35.998644 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:36.123771 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:36.126380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:36.194124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:36.194692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:36.195562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:36.196014 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:37.123419 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:37.148800 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4abcc4e5-837a-4b1c-9cf3-9532ffd4a461 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 1.207595 Jun 23 11:57:37.151236 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 166/352] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:35 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 1211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:37.167323 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:37.175197 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:37.226831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:37.232257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:37.234587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:37.239427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:37.240791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:37.543141 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:37.583585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-18d58546-0d92-4187-bcb9-37cbb0d645c5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1277 microversion: 2.1 time: 0.428385 Jun 23 11:57:37.585942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 167/353] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:37 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1277 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:37.935018 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:37.983921 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:37.993340 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:37.994633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c573bf7e-e047-4b24-8fe5-6c792481770d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 1.875905 Jun 23 11:57:38.016229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 187/354] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:36 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 1898 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:38.178868 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:38.179670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:38.213033 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:38.214034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:38.215478 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:38.216246 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:38.604554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:38.605148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:38.628127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:38.628584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:38.629434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:38.629873 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:38.966017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:38.978803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4e53166c-befd-46be-bc32-e0fa9c6b80e5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1277 microversion: 2.1 time: 0.378767 Jun 23 11:57:38.981377 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 188/355] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:38 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1277 bytes in 382 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:38.986242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:38.999123 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c188c78a-fe16-4969-bec1-81fb184c70d8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 0.832883 Jun 23 11:57:39.004439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 168/356] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:38 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 842 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:39.018894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:39.021638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:39.050195 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.050939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:39.051924 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.052995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:39.194316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-3bdc0566-b97b-4e5f-95ac-515939995461 req-e5583a44-1bcc-49be-bc39-65e94c6a2ffd service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7bee95-4d0f-4a24-9abc-1d972470a137", "tag": "e482920e-48e2-4b63-930d-1d004fbb0de0"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:39.225172 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-3bdc0566-b97b-4e5f-95ac-515939995461 req-e5583a44-1bcc-49be-bc39-65e94c6a2ffd service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:39.225879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-3bdc0566-b97b-4e5f-95ac-515939995461 req-e5583a44-1bcc-49be-bc39-65e94c6a2ffd service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:39.280815 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-3bdc0566-b97b-4e5f-95ac-515939995461 req-e5583a44-1bcc-49be-bc39-65e94c6a2ffd service nova] Creating event network-changed:e482920e-48e2-4b63-930d-1d004fbb0de0 for instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 on hv-cinder-82660 Jun 23 11:57:39.286940 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-3bdc0566-b97b-4e5f-95ac-515939995461 req-e5583a44-1bcc-49be-bc39-65e94c6a2ffd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.096501 Jun 23 11:57:39.289815 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 169/357] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:57:39.705009 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:39.722767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:39.732330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:39.734107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bcb87b82-eeaa-44db-af50-af098c3441f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.720859 Jun 23 11:57:39.750447 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 189/358] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:39 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 738 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:39.999666 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:40.000710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:40.024901 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:40.026271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:40.041548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:40.043181 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:40.048037 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:40.051920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:40.053891 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:40.054849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:40.060172 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:40.062393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:40.482352 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:40.497685 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f38a56c7-a872-449a-9822-27e31480982e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 0.478935 Jun 23 11:57:40.498340 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 190/359] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:40 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 481 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:40.722334 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-676825101", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:40.741882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:40.857836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] validate_networks() for None {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:57:41.251529 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:41.294073 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-83411130-f262-4310-8045-338a81109f18 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 1.296901 Jun 23 11:57:41.295354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 170/360] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:39 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 1302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:41.305372 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:41.306388 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:41.320580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:41.321514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:41.323477 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:41.324502 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:41.959369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:42.004191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=12 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:42.122521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:57:42.123801 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:57:42.125861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:57:42.126905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:57:42.127872 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:57:42.163086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.164485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.170968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.209026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Getting quotas for project d410564d1ba94f7883cd07fcf16be765. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:57:42.220750 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Getting quotas for user 74464ea11cbc4d44999583f93283a411 and project d410564d1ba94f7883cd07fcf16be765. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:57:42.240344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:57:42.243171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:57:42.329839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a84f1dd7-ca75-4729-8925-4fca9b54d5ab tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.608085 Jun 23 11:57:42.332775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 191/361] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:57:40 2022] POST /compute/v2.1/servers => generated 380 bytes in 1614 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:57:42.345999 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:42.349236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:42.362663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.363623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.364738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:42.366376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:42.968849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:42.978329 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:42.979455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:42.980638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-feb9d508-38c0-4456-bf4d-23be7a4ed5b3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 1.683824 Jun 23 11:57:42.981303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 171/362] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:41 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 1685 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:42.999379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e1b0a24c-6f23-498f-a2b7-4b99f5a6eb2c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:43.022453 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e1b0a24c-6f23-498f-a2b7-4b99f5a6eb2c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.024272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e1b0a24c-6f23-498f-a2b7-4b99f5a6eb2c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.208368 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e1b0a24c-6f23-498f-a2b7-4b99f5a6eb2c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Going to try to stop instance {{(pid=117747) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 11:57:43.294661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e1b0a24c-6f23-498f-a2b7-4b99f5a6eb2c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action" status: 202 len: 0 microversion: 2.1 time: 0.301362 Jun 23 11:57:43.296394 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 172/363] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:57:42 2022] POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action => generated 0 bytes in 314 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:57:43.302487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:43.303486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:43.332413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.333792 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.334887 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.335482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.361916 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:43.373791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6ce74bd0-9416-43c7-8114-eff38ab32a42 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 1.038543 Jun 23 11:57:43.378927 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 192/364] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:42 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 1045 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:43.391086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:43.395899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:43.410626 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.411365 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.412328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.412935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.544797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:43.558162 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ddae7b32-b0bd-409b-9945-c7031da367e2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1218 microversion: 2.1 time: 0.177764 Jun 23 11:57:43.559028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 193/365] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:43 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1218 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:43.563933 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:43.564845 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:43.575271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.575993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.577431 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:43.586243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:43.941811 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:43.951803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c10a38ad-be59-4f17-a673-ba679aaf7135 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.654444 Jun 23 11:57:43.952399 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 173/366] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:43 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 656 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:44.000540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-c7766d51-e725-4fd8-85e8-f99ff2be2be1 req-5e7901c4-ca8d-4db4-b157-db48c380f45a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b53cbaa7-867e-41fd-ae9d-437ed7dab927", "tag": "0b035da7-5c00-4cd0-8237-b2b2955053b7"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:44.002224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:44.018595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a28b3bb6-621b-4efd-b87d-21ab72dbd5fe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.454398 Jun 23 11:57:44.021019 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 194/367] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:43 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 461 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:44.025802 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c7766d51-e725-4fd8-85e8-f99ff2be2be1 req-5e7901c4-ca8d-4db4-b157-db48c380f45a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.026503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c7766d51-e725-4fd8-85e8-f99ff2be2be1 req-5e7901c4-ca8d-4db4-b157-db48c380f45a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.030248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:44.030904 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:44.050665 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.061853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.065194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.066145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-c7766d51-e725-4fd8-85e8-f99ff2be2be1 req-5e7901c4-ca8d-4db4-b157-db48c380f45a service nova] Creating event network-changed:0b035da7-5c00-4cd0-8237-b2b2955053b7 for instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 on hv-cinder-82660 Jun 23 11:57:44.066612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.072053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-c7766d51-e725-4fd8-85e8-f99ff2be2be1 req-5e7901c4-ca8d-4db4-b157-db48c380f45a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103400 Jun 23 11:57:44.076834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 174/368] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:44.393049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:44.394029 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:44.411606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.417242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.418218 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.419199 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.547374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:44.558494 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:44.560113 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:44.561605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d5715477-7c2c-4167-8b8c-5971fae350e2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.538406 Jun 23 11:57:44.574786 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 195/369] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:44 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:44.590066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:44.590681 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:44.620403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.630943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.631897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.636364 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.802130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:44.812605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c6df94dc-204b-4e0b-a7b3-d71e335d6473 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1210 microversion: 2.1 time: 0.236470 Jun 23 11:57:44.822954 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 196/370] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:44 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1210 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:44.968277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:44.968919 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:44.982216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.982845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:44.983008 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.983676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:44.984116 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:44.992363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d6033ca5-452f-4eec-9861-d051b8ec9fc3 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 0.604255 Jun 23 11:57:44.998233 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 175/371] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:44 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 611 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:45.025155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:45.037751 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:45.039111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:45.051326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.052311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:45.053325 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.053998 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:45.304818 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:45.321679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4fafa319-c336-45bf-aae1-97fa1dc4053d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.356879 Jun 23 11:57:45.323546 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 197/372] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:44 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:45.397647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=12 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:45.560234 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:45.588868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:45.594897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:45.598930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c32e1faa-4058-496a-9832-02546b5261eb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.565071 Jun 23 11:57:45.600563 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 176/373] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:45 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 567 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:45.613706 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.614185 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:45.615009 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.615450 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:45.834828 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:45.839950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:45.846879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:45.849547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:45.857061 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:45.860032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f4543c58-e11d-47b0-a553-c4d57616e062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.283815 Jun 23 11:57:45.870287 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.871161 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:45.876940 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 198/374] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:45 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:45.878831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:45.889375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.009808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:46.010394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:46.025986 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:46.026513 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.029124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:46.035176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.448200 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:46.461915 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:46.474521 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-36f8d8c8-042f-4a46-9de7-d8f47240a78c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1266 microversion: 2.1 time: 0.638987 Jun 23 11:57:46.475847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 177/375] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:45 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1266 bytes in 641 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:46.481795 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1590732076", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2860678-188a-43de-956c-7f6a2a5353f6"}], "security_groups": [{"name": "tempest-securitygroup--1804348562"}], "key_name": "tempest-keypair-707672602", "user_data": "}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:46.502480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f72b4202-55b4-4b29-9fa4-7f2a24d42532 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 0.485306 Jun 23 11:57:46.503151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 199/376] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:46 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:57:46.518062 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:46.522747 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:46.555224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:46.557238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.014s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.564618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:46.571580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.936970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:46.946328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-26d689a7-50af-4edd-8f9d-73744d3045c3 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.439864 Jun 23 11:57:46.949060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 200/377] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:46 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:46.963768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:46.967467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:46.986080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:46.987641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:46.989344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:46.990213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:47.229382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:47.244118 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-481cc153-b939-403d-9ef4-4b944d4560b4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.291371 Jun 23 11:57:47.246579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 201/378] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:46 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:47.269692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:47.270659 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:47.286769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:47.287577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:47.288769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:47.289463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:47.801341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:47.815777 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:47.823666 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:47.825492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c55631c8-f30b-4880-9edf-dddead5fa26e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1743 microversion: 2.20 time: 0.577616 Jun 23 11:57:47.826256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 202/379] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:47 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1743 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:47.845874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:47.849342 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:47.877827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:47.878579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:47.880946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:47.887129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.095845 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:48.107151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d6f06fc7-6689-4640-b09d-f1ec6fc0dabb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1272 microversion: 2.1 time: 0.279623 Jun 23 11:57:48.110093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 203/380] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:47 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1272 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:48.140458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:48.141562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:48.157529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.157822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.158629 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.159064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.548198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:48.558814 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d8c97a4c-0c6b-4965-82ba-ff4e7cc23539 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 0.445912 Jun 23 11:57:48.561177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 204/381] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:48 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:48.565599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:48.570248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:48.585165 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.586078 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.590872 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.591662 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.855060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:48.865713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3bebdd2f-4a8f-4532-94f2-092a753d8441 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.304824 Jun 23 11:57:48.867261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 205/382] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:48 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:48.873982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:48.875350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:48.890910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.891376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:48.892182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:48.893594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.201588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:49.219649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-33d507d1-e108-4201-9b58-6ddf946dd4b5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.351071 Jun 23 11:57:49.226385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 206/383] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:48 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:49.236170 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:49.248978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:49.260307 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:49.260966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.261868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:49.266386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.748272 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:49.767861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:49.772343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:49.779248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-756437ce-45c1-4bd6-bfb2-324c7cfce6db tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1743 microversion: 2.20 time: 0.548559 Jun 23 11:57:49.780352 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 207/384] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:49 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1743 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:49.790008 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-b9b5fa1d-a1b2-467c-9bb2-ed9fd091c0a5 req-e363d71b-026f-45a3-a2a0-abeb750d8831 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7bee95-4d0f-4a24-9abc-1d972470a137", "name": "network-vif-plugged", "status": "completed", "tag": "e482920e-48e2-4b63-930d-1d004fbb0de0"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:49.801957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-b9b5fa1d-a1b2-467c-9bb2-ed9fd091c0a5 req-e363d71b-026f-45a3-a2a0-abeb750d8831 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:49.802781 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-b9b5fa1d-a1b2-467c-9bb2-ed9fd091c0a5 req-e363d71b-026f-45a3-a2a0-abeb750d8831 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.826316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-b9b5fa1d-a1b2-467c-9bb2-ed9fd091c0a5 req-e363d71b-026f-45a3-a2a0-abeb750d8831 service nova] Creating event network-vif-plugged:e482920e-48e2-4b63-930d-1d004fbb0de0 for instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 on hv-cinder-82660 Jun 23 11:57:49.838625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-b9b5fa1d-a1b2-467c-9bb2-ed9fd091c0a5 req-e363d71b-026f-45a3-a2a0-abeb750d8831 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054811 Jun 23 11:57:49.839579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 208/385] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:49.847209 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:49.850069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:49.862518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:49.863254 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.864211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:49.865869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:49.986542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:50.003545 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c592ec3e-7bb5-409b-b3aa-52882b8c1be1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1272 microversion: 2.1 time: 0.160953 Jun 23 11:57:50.016216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 209/386] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:49 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1272 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:50.022242 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:50.023780 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:50.034892 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.035643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:50.037319 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.038036 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:50.426922 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:50.439821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-71dd9312-0cbf-4b9e-8d04-d07c85316d74 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 0.420012 Jun 23 11:57:50.441082 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 210/387] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:50 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:50.461238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:50.462173 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:50.477864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.480980 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:50.484179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.484868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:50.813293 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:50.832949 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3ca564f2-754e-4768-bfef-95932ff6ab7f tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.390456 Jun 23 11:57:50.834403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 211/388] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:50 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 392 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:50.844018 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:50.851498 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:50.870499 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.872875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:50.873884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:50.875401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.294773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:51.311367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2856c613-cd05-4466-a667-d994d31a46fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.472971 Jun 23 11:57:51.312154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 212/389] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:50 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 477 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:51.320962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:51.335679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:51.347749 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.355934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.357104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.357787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.778179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:51.794095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:51.796135 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:51.798050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d62e1adc-e4a6-4b06-ab9f-e51c8f1cdf5b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.484728 Jun 23 11:57:51.806174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 213/390] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:51 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:51.811341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:51.813791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:51.821085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.821798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:51.825687 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:51.826361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.127845 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:52.146210 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:52.149982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e83334c4-858b-43aa-916d-ebcc23a247b1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.342165 Jun 23 11:57:52.152359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 214/391] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:51 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:52.158339 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:52.159354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:52.169850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.171473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.173119 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.173723 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.210777 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:52.237971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=6 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:52.453156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:52.468905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7b7adbc4-8e97-42c4-94f9-42c7173054c9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1369 microversion: 2.1 time: 0.314929 Jun 23 11:57:52.479910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 215/392] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:52 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1369 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:52.488437 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:52.489946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:52.497428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.498214 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.499929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.500602 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.764244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:52.776125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-38d38f1d-4b19-4304-b79a-a4d46591a8a8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.294377 Jun 23 11:57:52.779905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 216/393] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:52 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:52.784725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:52.785327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:52.801934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.802394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:52.803190 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:52.803625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.192558 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:53.218021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f05a2d08-a313-4e08-8c98-76ccb8d1d982 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.436983 Jun 23 11:57:53.218829 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 217/394] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:52 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:53.243012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:53.243652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:53.263009 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.263456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.264236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.264662 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.568647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:53.581625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:53.586907 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:53.588955 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-516a87ee-5ce9-4443-9b0a-0d927f0957f2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.369036 Jun 23 11:57:53.590053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 218/395] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:53 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:53.600456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-92d302a5-cfc3-4cd2-9f9d-152ab373ec2d req-bab3daab-8444-40d1-ab63-a4d5a2394905 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ec4d3-4ce1-4fbd-81ea-025a5c724421", "name": "network-vif-plugged", "status": "completed", "tag": "8e9b4dc6-7a9c-4183-b1a8-10297c792e0e"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:53.614760 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-92d302a5-cfc3-4cd2-9f9d-152ab373ec2d req-bab3daab-8444-40d1-ab63-a4d5a2394905 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.615598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-92d302a5-cfc3-4cd2-9f9d-152ab373ec2d req-bab3daab-8444-40d1-ab63-a4d5a2394905 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.632930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-92d302a5-cfc3-4cd2-9f9d-152ab373ec2d req-bab3daab-8444-40d1-ab63-a4d5a2394905 service nova] Creating event network-vif-plugged:8e9b4dc6-7a9c-4183-b1a8-10297c792e0e for instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 on hv-cinder-82660 Jun 23 11:57:53.642396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-92d302a5-cfc3-4cd2-9f9d-152ab373ec2d req-bab3daab-8444-40d1-ab63-a4d5a2394905 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050875 Jun 23 11:57:53.644507 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 219/396] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:53.666271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:53.666983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:53.705327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.705782 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.706579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.707014 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.918794 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:53.927990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f40825ca-5d4e-42fe-ad6b-6846ea5ac12a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.281929 Jun 23 11:57:53.942721 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 220/397] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:53 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:53.949151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-486058c9-a572-47bf-8ed3-9d59813179c3 req-a0c67587-c30d-4d27-8383-d0c20e07bef0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "567ad1bf-ef6b-41f9-800f-f589f136a1b6", "tag": "eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:53.958834 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-486058c9-a572-47bf-8ed3-9d59813179c3 req-a0c67587-c30d-4d27-8383-d0c20e07bef0 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:53.959436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-486058c9-a572-47bf-8ed3-9d59813179c3 req-a0c67587-c30d-4d27-8383-d0c20e07bef0 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:53.976445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-486058c9-a572-47bf-8ed3-9d59813179c3 req-a0c67587-c30d-4d27-8383-d0c20e07bef0 service nova] Creating event network-changed:eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3 for instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 on hv-cinder-82660 Jun 23 11:57:53.985962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-486058c9-a572-47bf-8ed3-9d59813179c3 req-a0c67587-c30d-4d27-8383-d0c20e07bef0 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041678 Jun 23 11:57:53.987266 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 221/398] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:53.996413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:53.997334 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:54.006434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.007081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.010654 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.011348 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.310084 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:54.322488 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a88df9f0-1b1e-4678-89a0-ced351edc7c1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1564 microversion: 2.1 time: 0.333509 Jun 23 11:57:54.328166 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 222/399] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:53 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1564 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:54.338931 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:54.344598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:54.351990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.352775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.354516 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.355140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.596073 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:54.618741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cf9a652d-a003-4d7d-9f44-408f89dcc0b8 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.289184 Jun 23 11:57:54.628857 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 223/400] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:54 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:54.634605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:54.635433 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:54.642201 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.642764 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.643618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.644133 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.836196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:54.845576 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c99d540d-5a4c-4f8f-a48d-88f51b9fc7fa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.215182 Jun 23 11:57:54.846543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 224/401] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:54 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:54.851163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3218ff84-a883-4376-9c24-3b26a1f746b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:54.851642 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3218ff84-a883-4376-9c24-3b26a1f746b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:54.862599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3218ff84-a883-4376-9c24-3b26a1f746b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.862599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3218ff84-a883-4376-9c24-3b26a1f746b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:54.863188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3218ff84-a883-4376-9c24-3b26a1f746b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:54.863842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3218ff84-a883-4376-9c24-3b26a1f746b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.009570 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3218ff84-a883-4376-9c24-3b26a1f746b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.161884 Jun 23 11:57:55.019215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 225/402] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 11:57:54 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-interface => generated 285 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:55.034664 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:55.035377 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:55.059377 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.060712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.061875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.062730 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.598898 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:55.617779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:55.619655 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:55.621081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-13bacaac-7185-4fbd-b9a4-164831da5860 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.597623 Jun 23 11:57:55.624353 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 226/403] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:55 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 604 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:55.629486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:55.630385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:55.647646 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.648104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.648950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.649377 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.935084 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:55.944479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-67dd117e-7c03-4793-b7a6-368f637dcfb2 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.318747 Jun 23 11:57:55.947791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 227/404] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:55 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:55.955742 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:55.962329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:55.969805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.976737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:55.978278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:55.981365 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.238504 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:56.253551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c38ee948-2460-46bd-b8fe-46d0f548af21 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.304497 Jun 23 11:57:56.256825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 228/405] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:55 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:56.263200 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-8a7b7a22-4887-420c-a0c9-ffa5d968c903 req-47a945a1-f84f-4087-a333-5a5a0ea1c621 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53cbaa7-867e-41fd-ae9d-437ed7dab927", "name": "network-vif-plugged", "status": "completed", "tag": "0b035da7-5c00-4cd0-8237-b2b2955053b7"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:56.290278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-8a7b7a22-4887-420c-a0c9-ffa5d968c903 req-47a945a1-f84f-4087-a333-5a5a0ea1c621 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.291978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-8a7b7a22-4887-420c-a0c9-ffa5d968c903 req-47a945a1-f84f-4087-a333-5a5a0ea1c621 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.316297 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-8a7b7a22-4887-420c-a0c9-ffa5d968c903 req-47a945a1-f84f-4087-a333-5a5a0ea1c621 service nova] Creating event network-vif-plugged:0b035da7-5c00-4cd0-8237-b2b2955053b7 for instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 on hv-cinder-82660 Jun 23 11:57:56.330763 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-8a7b7a22-4887-420c-a0c9-ffa5d968c903 req-47a945a1-f84f-4087-a333-5a5a0ea1c621 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.072290 Jun 23 11:57:56.332299 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 229/406] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:56.339248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:56.341252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:56.355822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.363401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.364511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:56.365146 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:56.457272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:56.508738 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=4 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:57.058911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:57.069984 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-529f7177-c65f-452f-8601-aedb413e4901 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.736178 Jun 23 11:57:57.080883 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 230/407] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:56 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 747 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:57.089327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:57.094768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:57.101610 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:57.102832 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:57.105101 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:57.105813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:57.557156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:57.567225 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:57.579040 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:57.580386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5f6e8280-522e-4ffe-8cca-689a927e90ac tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.497226 Jun 23 11:57:57.581073 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 231/408] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:57 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:57.595562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:57.596285 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:57.607557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:57.610807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:57.611325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:57.611843 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:57.958722 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:57.975798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-13ff87ec-4d10-4406-959e-c800594d7b21 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.393565 Jun 23 11:57:57.976602 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 232/409] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:57 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:57.985056 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:57.989697 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:58.010324 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:58.010776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:58.011566 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:58.011999 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:58.328216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:58.335913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:58.347350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-94feeccd-bdab-48c9-95c8-5b7a7e1f3477 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1319 microversion: 2.1 time: 0.369161 Jun 23 11:57:58.348145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 233/410] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:57 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1319 bytes in 371 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:58.372564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-180e5ce2-17d0-4934-a528-31a372446030 req-e995989f-6607-47e7-9697-571d39f15d6f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7bee95-4d0f-4a24-9abc-1d972470a137", "tag": "e482920e-48e2-4b63-930d-1d004fbb0de0"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:57:58.389544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:57:58.392203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-180e5ce2-17d0-4934-a528-31a372446030 req-e995989f-6607-47e7-9697-571d39f15d6f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:58.392862 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-180e5ce2-17d0-4934-a528-31a372446030 req-e995989f-6607-47e7-9697-571d39f15d6f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:58.411346 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-180e5ce2-17d0-4934-a528-31a372446030 req-e995989f-6607-47e7-9697-571d39f15d6f service nova] Creating event network-changed:e482920e-48e2-4b63-930d-1d004fbb0de0 for instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 on hv-cinder-82660 Jun 23 11:57:58.417472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-180e5ce2-17d0-4934-a528-31a372446030 req-e995989f-6607-47e7-9697-571d39f15d6f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059120 Jun 23 11:57:58.418179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 234/411] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:57:58.426792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:58.427536 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:58.435356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:58.435807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:58.436596 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:58.437059 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:58.755810 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:58.767148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b4935881-71ef-4525-a82a-1e6b027045ce tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.344752 Jun 23 11:57:58.781512 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 235/412] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:58 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:58.787320 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:58.787676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:58.795429 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:58.796267 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:58.797082 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:58.797532 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:59.181799 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:59.196457 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:59.215179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:59.216443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9676e942-dd16-4508-b101-8c26ba7debed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.433830 Jun 23 11:57:59.217041 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 236/413] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:57:58 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:57:59.243716 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:59.244383 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:59.273020 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:59.273734 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:59.274792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:59.275964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:59.564518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:59.608901 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-38a9f034-74be-40df-b880-ea89ae67e9a1 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.364506 Jun 23 11:57:59.610683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 237/414] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:59 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 393 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:59.616559 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:59.617636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:59.627045 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:59.627905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:59.629227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:59.630354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:59.899742 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:57:59.909385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-57234809-1553-4ff7-9aca-25600333e242 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1507 microversion: 2.1 time: 0.297257 Jun 23 11:57:59.920703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 238/415] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:59 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1507 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:57:59.920703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:57:59.920703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:57:59.924470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:59.924949 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:57:59.925748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:57:59.926184 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:00.207357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:00.221143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9a62bf17-48ee-4a57-a579-3f0fb2778c0b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.309318 Jun 23 11:58:00.231461 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 239/416] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:57:59 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:00.234305 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b495edc5-cbcb-480f-804e-e398b61f8c5d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87bf0f9e-9371-477d-9d68-fba0362fbf49", "device": "/dev/sdb"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:00.242420 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b495edc5-cbcb-480f-804e-e398b61f8c5d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:00.256224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b495edc5-cbcb-480f-804e-e398b61f8c5d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:00.256773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b495edc5-cbcb-480f-804e-e398b61f8c5d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:00.258419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b495edc5-cbcb-480f-804e-e398b61f8c5d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:00.258924 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b495edc5-cbcb-480f-804e-e398b61f8c5d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:00.658793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b495edc5-cbcb-480f-804e-e398b61f8c5d tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "POST /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.433567 Jun 23 11:58:00.671695 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 240/417] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:58:00 2022] POST /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927/os-volume_attachments => generated 194 bytes in 449 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:00.682523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:00.690163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:00.707064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:00.707965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:00.709064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:00.711104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:00.983021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:00.995185 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:00.996903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:00.998351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6dee4956-6fc3-4916-889c-cdaf10e95278 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.325154 Jun 23 11:58:00.999288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 241/418] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:00 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:01.003876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:01.004480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:01.011861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:01.012382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:01.013250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:01.013748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:01.188951 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:01.202987 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-63cbb690-e7ea-4389-93e7-a48ccfefb69a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.202631 Jun 23 11:58:01.203912 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 242/419] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:00 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:01.251566 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:01.252275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:01.260201 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:01.260825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:01.261818 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:01.262449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:01.304840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] validate_networks() for [('e2860678-188a-43de-956c-7f6a2a5353f6', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:58:01.421237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:01.430179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-81d07c29-bf91-4345-a526-c51f9b288570 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.186706 Jun 23 11:58:01.444517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 243/420] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:01 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:01.776514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:58:01.776973 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:58:01.777701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:58:01.778396 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:58:01.778962 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:58:01.789449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:01.790451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:01.791347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:01.791779 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:01.819476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:58:01.823728 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:58:01.835367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:58:01.838222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:58:01.887598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fa1dc0a4-daa5-421d-b7de-f2097d2197b3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 15.410066 Jun 23 11:58:01.888243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 178/421] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:57:46 2022] POST /compute/v2.1/servers => generated 402 bytes in 15412 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 11:58:01.898368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1fc5c9a8-8cde-45ed-a55a-e520a69ca687 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:01.898985 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1fc5c9a8-8cde-45ed-a55a-e520a69ca687 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:01.978056 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1fc5c9a8-8cde-45ed-a55a-e520a69ca687 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:01.991324 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1fc5c9a8-8cde-45ed-a55a-e520a69ca687 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1241 microversion: 2.1 time: 0.096726 Jun 23 11:58:01.992231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 244/422] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:01 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1241 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:02.016924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:02.018593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:02.030284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:02.031280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:02.032308 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:02.032948 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:02.213952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:02.219790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:02.220802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:02.227446 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:02.229399 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:02.230666 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3d333e03-f6be-4f02-bc2d-cb40737fe21b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.218252 Jun 23 11:58:02.239246 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 179/423] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:02 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:02.249479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:02.250172 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:02.251242 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:02.251891 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:02.427643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:02.445590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fc3555cf-8a1a-42e0-8767-1ab641f45379 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.229621 Jun 23 11:58:02.446185 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 245/424] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:02 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:02.448594 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:02.450475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:02.459922 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:02.461141 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:02.461957 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:02.462398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:02.521754 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-40359dda-1e03-45fc-8576-3c649685efdb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Action: 'create', calling method: .version_select at 0x7f3ae60f74c0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-682795558", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJpO/87S3Kx37IyRhLIf/CW9rHOlWjShxCukhLURP8QJ7ZGogrpu7Gd0XT55JaT07gGcRXmdH3dcW3JL1cNsY8UdsRv98QthWt6xq9xa8hkaBQUj21pyCyZr9HNJLiTLxw=="}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:02.540766 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-40359dda-1e03-45fc-8576-3c649685efdb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Getting quotas for project 45aa73614bc447bdb1bfda38ad541ab3. Resources: {'key_pairs'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:58:02.545118 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-40359dda-1e03-45fc-8576-3c649685efdb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Getting quotas for user 2658206b0a934bd8861a49701ab41659 and project 45aa73614bc447bdb1bfda38ad541ab3. Resources: {'key_pairs'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:58:02.583024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-40359dda-1e03-45fc-8576-3c649685efdb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.066782 Jun 23 11:58:02.584753 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 246/425] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 11:58:02 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:58:02.644332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:02.653089 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-801772312", "imageRef": "711f2405-d0ce-485c-bcf4-0e763b8c7807", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-682795558", "networks": [{"uuid": "33bf599f-e007-4787-9458-fbe47f8701cd"}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:02.655558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-990c64a0-622a-40ea-a9c6-e31cc75bcb6d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.212070 Jun 23 11:58:02.665442 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 180/426] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:02 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:03.015034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:03.015866 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:03.055679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] validate_networks() for [('33bf599f-e007-4787-9458-fbe47f8701cd', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 11:58:03.060983 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.061475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.062264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.062712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.166180 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:03.175011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e71f200c-a99f-4a5d-a563-a200cf26a795 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1293 microversion: 2.1 time: 0.170979 Jun 23 11:58:03.175836 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 181/427] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:03 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1293 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:03.254059 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:03.254683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:03.264222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.270207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.272150 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.272796 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.524652 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:03.536105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:03.544622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:03.549690 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7158b092-e849-4459-bac5-8f3c8e46419a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.299649 Jun 23 11:58:03.550761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 182/428] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:03 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:03.555637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:03.566430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:03.578304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.579008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.579954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.586187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.719635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 11:58:03.720182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 11:58:03.722086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 11:58:03.722515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 11:58:03.722927 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 11:58:03.739114 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.742960 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.743911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.744429 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.776562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Getting quotas for project 45aa73614bc447bdb1bfda38ad541ab3. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:58:03.781184 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Getting quotas for user 2658206b0a934bd8861a49701ab41659 and project 45aa73614bc447bdb1bfda38ad541ab3. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:58:03.793317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 11:58:03.795712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='711f2405-d0ce-485c-bcf4-0e763b8c7807',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 11:58:03.851542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1d483620-59e2-4194-b820-fb91e49231dd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.202645 Jun 23 11:58:03.858204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 247/429] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 11:58:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 1210 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 11:58:03.863964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:03.864960 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:03.873340 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.874165 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.876288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:03.877359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:03.896532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:03.907437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-439782d9-8e96-4c3b-be8f-ab18ccc31da0 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.353769 Jun 23 11:58:03.909411 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 183/430] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:03 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 358 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:03.932988 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dfb6add2-02d1-43db-b301-4d50c30453f3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:03.934061 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-dfb6add2-02d1-43db-b301-4d50c30453f3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:04.084322 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:04.095557 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-dfb6add2-02d1-43db-b301-4d50c30453f3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:04.096081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ab89866c-0387-4243-befb-574fadd32f9c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.236253 Jun 23 11:58:04.096692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 248/431] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:03 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:04.112646 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-dfb6add2-02d1-43db-b301-4d50c30453f3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1257 microversion: 2.1 time: 0.190238 Jun 23 11:58:04.113479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 184/432] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:03 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1257 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:04.203130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:04.204288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:04.211106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:04.211962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:04.213507 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:04.214126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:04.387557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:04.418582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7448ae02-daa6-4332-b0e9-bc1aaa6145dc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1299 microversion: 2.1 time: 0.224463 Jun 23 11:58:04.419384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 249/433] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:04 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1299 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:04.577883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:04.579263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:04.608370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:04.610089 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:04.611085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:04.611681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:04.928702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:04.929426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:04.950237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:04.956806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:04.970812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:04.983757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:05.323233 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:05.338070 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:05.350514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:05.351761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-508b7d23-5a1e-4b38-bff4-8b74764e3b09 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.786232 Jun 23 11:58:05.352629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 185/434] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:04 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 788 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:05.364137 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:05.365050 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:05.373040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:05.374715 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:05.375786 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:05.376373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:05.507048 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:05.519237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0a8e4409-475a-406b-8b95-fb3515bacd6f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.594839 Jun 23 11:58:05.524252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 250/435] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:04 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:05.533691 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:05.542787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:05.561107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:05.564865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:05.567125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:05.568659 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:05.718461 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:05.729864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2b730fd4-b45b-4e18-ad27-1eee56917d8b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1309 microversion: 2.1 time: 0.199669 Jun 23 11:58:05.740812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 251/436] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:05 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1309 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:05.748207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:05.749213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:05.761554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:05.763129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:05.764372 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:05.765356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:05.791016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:06.059638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:06.076062 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7df13806-ba31-4797-bafc-abf25083af9e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.722039 Jun 23 11:58:06.086037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:06.088304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 186/437] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:05 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 735 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:06.100575 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b7eb5052-07a6-49de-aa20-6ee04650baf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.356363 Jun 23 11:58:06.101722 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 252/438] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:05 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:06.373300 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:06.374493 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:06.386778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:06.387223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:06.388004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:06.390991 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:06.543443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:06.544304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:06.557944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:06.558865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:06.560104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:06.560794 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:06.860024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:06.872644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-88d34d0d-cef7-482c-aca1-26602a9fc3d6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.333644 Jun 23 11:58:06.874315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 253/439] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:06 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:06.880483 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:06.885125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:06.898552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:06.899303 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:06.900499 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:06.901484 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:07.067616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:07.079347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:07.085001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f0efccd2-2342-486d-abd6-66970fdf75fc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1315 microversion: 2.1 time: 0.208350 Jun 23 11:58:07.100058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 254/440] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:06 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1315 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:07.111286 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:07.111735 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:07.114825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:07.121462 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:07.125803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:07.126162 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-776dfd5c-25fc-40d6-b8a3-a1455b0edb1f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.758510 Jun 23 11:58:07.126846 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:07.128251 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 187/441] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:06 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 762 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:07.129280 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:07.130222 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:07.140577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:07.145503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:07.162555 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:07.163020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:07.163891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:07.164330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:07.519083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:07.531200 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-355024a0-79cd-492f-a3f4-c17163f85d86 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.429899 Jun 23 11:58:07.532605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 255/442] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:07 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:07.638508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-4d3e1e86-32b5-4fbe-88ac-a78c0a634783 req-92a33909-5925-4bf7-a84b-b47927bdab75 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567ad1bf-ef6b-41f9-800f-f589f136a1b6", "name": "network-vif-plugged", "status": "completed", "tag": "eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:07.657898 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-4d3e1e86-32b5-4fbe-88ac-a78c0a634783 req-92a33909-5925-4bf7-a84b-b47927bdab75 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:07.658679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-4d3e1e86-32b5-4fbe-88ac-a78c0a634783 req-92a33909-5925-4bf7-a84b-b47927bdab75 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:07.716308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-4d3e1e86-32b5-4fbe-88ac-a78c0a634783 req-92a33909-5925-4bf7-a84b-b47927bdab75 service nova] Creating event network-vif-plugged:eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3 for instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 on hv-cinder-82660 Jun 23 11:58:07.722875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:07.734489 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f7e30e7c-a778-45eb-bcbb-85f62f053aae tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.604306 Jun 23 11:58:07.735429 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 188/443] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:07 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 606 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:07.747909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-4d3e1e86-32b5-4fbe-88ac-a78c0a634783 req-92a33909-5925-4bf7-a84b-b47927bdab75 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.115322 Jun 23 11:58:07.752870 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 256/444] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:07.889980 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:07.890517 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:07.906779 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:07.909687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:07.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:07.911003 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.116011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:08.119485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:08.140092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.142676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.147318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.151769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.233386 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:08.259157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1575e95e-53e1-4310-a905-916dec3db625 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.372463 Jun 23 11:58:08.262151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 189/445] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:07 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:08.281277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:08.282160 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:08.295646 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.296453 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.297756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.298205 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.586612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:08.612966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-584b2c4b-897b-415a-b9fb-c22bec72b6fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.494998 Jun 23 11:58:08.623706 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 257/446] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:08 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:08.647523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-42856ba0-d4be-47e0-8403-ba74594eb473 req-5fdfee63-32e0-4c69-bb6c-c1c0642c37ee service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a64ae5-5786-41de-9862-e321b902937a", "tag": "fe3999d6-abf8-455b-97de-e88dd06b7caa"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:08.666439 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-42856ba0-d4be-47e0-8403-ba74594eb473 req-5fdfee63-32e0-4c69-bb6c-c1c0642c37ee service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.667455 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-42856ba0-d4be-47e0-8403-ba74594eb473 req-5fdfee63-32e0-4c69-bb6c-c1c0642c37ee service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.707301 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-42856ba0-d4be-47e0-8403-ba74594eb473 req-5fdfee63-32e0-4c69-bb6c-c1c0642c37ee service nova] Creating event network-changed:fe3999d6-abf8-455b-97de-e88dd06b7caa for instance b2a64ae5-5786-41de-9862-e321b902937a on hv-cinder-82660 Jun 23 11:58:08.716068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-42856ba0-d4be-47e0-8403-ba74594eb473 req-5fdfee63-32e0-4c69-bb6c-c1c0642c37ee service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.090891 Jun 23 11:58:08.717403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 258/447] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:08.730211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:08.731115 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:08.753290 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.753742 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.754529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.754962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.834638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:08.848598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:08.857551 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:08.859157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3a4e581b-c6c5-4e9e-9f1b-c7d03ca3cf03 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.595409 Jun 23 11:58:08.863515 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 190/448] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:08 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 601 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:08.879227 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:08.880124 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:08.886826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.890584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:08.891616 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:08.896208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:09.054590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:09.068582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-510482b5-102b-4ec4-a851-3d75b5f753f6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.349622 Jun 23 11:58:09.082080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 259/449] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:08 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:09.168364 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:09.185028 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-01c7469c-2a0c-4edb-8d0e-98d986c8c9d4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.320139 Jun 23 11:58:09.185876 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 191/450] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:08 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:09.279187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:09.280258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:09.288040 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:09.293452 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:09.295450 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:09.297987 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:09.542278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:09.552409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-df210370-7bb0-4dd1-b308-64d00d85335c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.276894 Jun 23 11:58:09.553794 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 260/451] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:09 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:09.630911 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:09.632105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:09.643488 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:09.644222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:09.651773 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:09.652449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:09.882474 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:09.883082 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:09.895332 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:09.895779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:09.896564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:09.897021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:09.924090 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:09.934710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f21a32d3-8e23-4cf7-9657-672634d64b6b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.307002 Jun 23 11:58:09.935972 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 192/452] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:09 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:10.100621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:10.101945 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:10.114606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.115061 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:10.115844 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.116278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:10.206691 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:10.218471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:10.222450 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:10.224349 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-52e44717-a7e1-43e1-a3dc-8b02a62cfdea tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.345718 Jun 23 11:58:10.237423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 261/453] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:09 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 359 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:10.267249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:10.267863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:10.275786 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.276229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:10.277035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.277458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:10.435079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:10.449742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4c75c40f-4632-4408-a729-71276f4845e0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.353309 Jun 23 11:58:10.450691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 193/454] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:10 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:10.564508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:10.570738 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:10.572250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:10.580287 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.581047 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:10.582210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.582906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:10.593473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-97e21e1b-e736-432e-9d5f-5445e010daba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.353824 Jun 23 11:58:10.594411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 262/455] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:10 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:10.816865 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:10.829117 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-662fb67c-0df6-4ad3-928e-b52abe445369 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.262586 Jun 23 11:58:10.839112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 194/456] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:10 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:10.958580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:10.960116 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:10.971684 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.983786 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:10.989533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:10.990561 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.198032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:11.206572 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a2afaef6-ecb7-418c-989a-aa5198f82632 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.252122 Jun 23 11:58:11.216757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 263/457] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:10 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:11.245359 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:11.246232 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:11.253028 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.253490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.258413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.258944 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.460509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:11.468057 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:11.468916 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:11.471463 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:11.473398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:11.474768 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-86ef0fb5-88d6-433d-9f7e-09329d6d3c81 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.234046 Jun 23 11:58:11.475500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 195/458] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:11 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:11.498794 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.499390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.500275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.500992 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.615932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:11.617180 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:11.641076 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.644915 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.646020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.646564 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.653316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:11.753601 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:11.768396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c85aa856-8263-4ac7-aa30-cac22e867e79 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.304678 Jun 23 11:58:11.790134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 264/459] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:11 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:11.799567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:11.846500 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:11.847125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:11.880315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.880836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.881599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:11.882040 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:11.890478 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:11.902598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f154d304-f9e6-47dd-aece-b2942e2626aa tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.292653 Jun 23 11:58:11.902598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 196/460] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:11 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:12.053028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:12.061297 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d5860b74-5f37-4334-b50f-92ed4d2a3711 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.219084 Jun 23 11:58:12.064859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 265/461] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:11 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:12.225706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:12.226697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:12.234208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.234208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:12.235035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.235498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:12.435938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:12.451642 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bf0b37f4-aec9-4719-b4f5-b030a53feed0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.229965 Jun 23 11:58:12.452471 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 197/462] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:12 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:12.498988 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:12.499920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:12.517133 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.519265 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:12.524005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.529345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:12.697586 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:12.707147 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:12.709124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:12.710281 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-66ad0df9-265c-406d-8c4d-941fe984ab7f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.219988 Jun 23 11:58:12.711351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 266/463] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:12 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:12.796352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:12.797186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:12.820807 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.822642 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:12.823903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.824793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:12.920381 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:12.921423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:12.928387 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.929821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:12.930404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:12.930955 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:13.076516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:13.096035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-56c10ede-b42c-45e8-b838-be7704516b98 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.308069 Jun 23 11:58:13.109372 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 198/464] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:12 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:13.117652 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:13.118267 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:13.125213 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:13.125662 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:13.126439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:13.126917 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:13.198663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:13.207443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-63257f3d-4b27-455f-8f15-dda156cba454 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.291612 Jun 23 11:58:13.219257 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 267/465] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:12 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:13.358283 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:13.372201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-acabd041-688b-4014-9eae-466a5d77e745 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.261395 Jun 23 11:58:13.373129 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 199/466] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:13 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:13.474591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:13.475885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:13.496792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:13.498600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:13.500625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:13.501781 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:13.689881 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:13.704034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-af923c28-b22e-4c5f-9ec5-a5ccc1e539e3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.236327 Jun 23 11:58:13.705328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 268/467] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:13 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:13.734594 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:13.735129 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:13.750744 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:13.751481 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:13.752439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:13.753274 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.037581 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:14.054455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:14.057113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:14.058496 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d4a194e5-922d-4de4-a8ac-f30dc01a4ff9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.333114 Jun 23 11:58:14.069936 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 200/468] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:13 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:14.120886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:14.122105 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:14.131965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:14.133241 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=12 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:14.137912 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.138824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.140304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.141335 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.228532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:14.229354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:14.231375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=8 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:14.238259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.238877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.239997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.240745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.360276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:14.369556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a0737e3e-69cf-40ab-b4fb-1ccde88e2dfa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.256119 Jun 23 11:58:14.380773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 269/469] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:14 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:14.391833 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:14.392533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:14.399127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:14.401789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.402547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.403595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.404173 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.423258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:14.479890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:14.500532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5b5ead19-1d42-4347-a15d-43d283106ecd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.277526 Jun 23 11:58:14.525074 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 201/470] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:14 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:14.637195 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:14.645859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cc8ed384-6bd7-4106-a409-c6dd678e2439 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.258216 Jun 23 11:58:14.646343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 270/471] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:14 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:14.731211 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:14.733883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:14.747060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.749306 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.750857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:14.753914 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:14.938040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:14.948148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-dcb3506e-77f1-499c-a1ba-b0a45da1f3de tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.221630 Jun 23 11:58:14.949350 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 202/472] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:14 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:15.078329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:15.079059 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:15.088057 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.088600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.089536 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.089865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.273542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:15.284854 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:15.286380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:15.287947 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bd6b6c2c-b6e8-4d5c-af3e-817b8c7b2ce5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.213948 Jun 23 11:58:15.288517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 271/473] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:15 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:15.386717 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:15.387915 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:15.400952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.402045 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.403577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.409899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.522511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:15.523990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:15.543719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.544746 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.546398 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.547038 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.624907 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:15.636747 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-405fcc49-7c30-475e-a62f-b37892f59d3e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.253642 Jun 23 11:58:15.637634 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 203/474] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:15 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:15.668745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:15.672177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:15.693646 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.697822 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.698969 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.699603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.798767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:15.807406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-044f8c17-ab45-4c43-a85f-5958a78417a1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.289797 Jun 23 11:58:15.809820 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 272/475] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:15 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:15.904210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:15.913952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ee48017f-bf39-4392-ab30-0c9f4a843917 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.254377 Jun 23 11:58:15.925146 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 204/476] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:15 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:15.966909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:15.967634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:15.975037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.975488 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:15.976278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:15.976745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.157577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:16.165001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f741ac5e-21f8-4d5d-b255-a843c1b0bc22 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.203671 Jun 23 11:58:16.165625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 273/477] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:15 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:16.308213 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:16.309110 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:16.315734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.316496 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.317562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.318157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.521569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:16.529353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:16.530844 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:16.531986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b7d1c1df-9dcd-4152-91a4-9d36be97902c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.228991 Jun 23 11:58:16.532546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 205/478] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:16 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:16.653060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:16.653943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:16.660473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.661028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.661657 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.662092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.825428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:16.826060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:16.836072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.836520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.843737 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.844325 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.875858 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:16.885349 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f905bef7-27d5-4429-aeae-6214b0334854 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.235936 Jun 23 11:58:16.886617 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 274/479] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:16 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:16.933003 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:16.933879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:16.941021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.941869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:16.943023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:16.943621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:17.017799 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:17.027299 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7fe75ae2-556f-44ee-a453-7c9717b8792e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.206276 Jun 23 11:58:17.028133 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 206/480] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:16 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:17.116697 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:17.124535 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3ab0cf43-c8d7-4194-9cd8-2fb4dcf3a2e6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.196957 Jun 23 11:58:17.125240 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 275/481] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:16 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:17.181954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:17.182861 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:17.189212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:17.189656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:17.190423 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:17.190852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:17.362347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:17.370341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-527316b5-a919-4bb5-abfd-a752af2039b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.192258 Jun 23 11:58:17.371132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 207/482] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:17 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:17.550989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:17.551589 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:17.558197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:17.558644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:17.559406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:17.559874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:17.716946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:17.728649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:17.730139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:17.731367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e4470f5d-6803-44ec-bfb1-332c5ab429b2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.184507 Jun 23 11:58:17.731934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 276/483] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:17 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:17.903536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:17.904284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:17.911689 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:17.912136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:17.912992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:17.913434 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.044924 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:18.045524 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:18.052625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.053368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.054136 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.054559 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.062766 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:18.070988 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b0b69633-7828-4a6a-a4a0-918f8758667f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.171498 Jun 23 11:58:18.071551 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 208/484] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:17 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:18.147824 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:18.148446 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:18.155051 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.155512 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.156316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.157063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.191526 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:18.213569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5aa7be95-9acf-42a1-b7be-15e445c2588d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.159732 Jun 23 11:58:18.214565 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 277/485] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:18 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:18.324263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:18.331704 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ef8143f8-fd3b-43d3-b883-01ec8fd46f14 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.187739 Jun 23 11:58:18.332278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 209/486] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:18 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:18.389560 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:18.390241 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:18.398844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.399311 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.400609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.401086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.560605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:18.569438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f91132e9-c7e9-4b7b-8945-79f86b81d033 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.184936 Jun 23 11:58:18.570043 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 278/487] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:18 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:18.753283 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:18.753872 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:18.760079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.760559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.761546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:18.761990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:18.907447 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:18.919451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:18.920977 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:18.922520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f264b637-2fb7-48c3-bfcb-87e658ece30b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.173135 Jun 23 11:58:18.923134 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 210/488] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:18 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:19.090475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:19.091066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:19.097729 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.098181 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.098967 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.099405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.231552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:19.232170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:19.238462 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.239056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.239698 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.240136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.247456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:19.255599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-714f5d14-413d-4947-9450-7373aad317f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.171079 Jun 23 11:58:19.256177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 279/489] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:19 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:19.350131 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:19.350868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:19.358072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.358072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.359040 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.359581 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.383574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:19.392893 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3e98fb38-3d7c-46c5-893b-72fcf5b90ed5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.165713 Jun 23 11:58:19.393475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 211/490] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:19 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:19.503032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:19.510987 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f57fc855-17b4-4ccc-b0a8-ab5a2f268ec9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.165436 Jun 23 11:58:19.511661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 280/491] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:19 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:19.586876 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:19.588187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:19.594690 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.595206 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.596031 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.596517 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.737545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:19.740952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:19.745863 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-dffc49e8-23ea-435d-990e-5cb99e0d5bbc tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.162879 Jun 23 11:58:19.746419 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 212/492] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:19 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:19.941175 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:19.941781 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:19.948628 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.949103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:19.949863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:19.950292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.087578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:20.095915 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:20.097578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:20.098737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4d2e863d-4810-48f2-b447-c3c115d3f8bf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.161460 Jun 23 11:58:20.099307 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 281/493] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:19 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:20.273018 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:20.273631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:20.280264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.280744 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.281525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.281946 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.413235 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:20.414259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:20.422741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.423738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.424598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.425135 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.435920 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:20.444740 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9fded57c-81f7-4d83-9555-fbc83b59c56c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1721 microversion: 2.1 time: 0.175636 Jun 23 11:58:20.445324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 213/494] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:20 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:20.530288 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:20.531007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:20.538619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.539347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.541052 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.541631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.603544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:20.614509 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8f548447-243f-4199-891c-373b7ce9e2a6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.206576 Jun 23 11:58:20.618849 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 282/495] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:20 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:20.763296 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:20.763906 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:20.770111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.770548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.771312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:20.771735 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:20.809574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:20.819469 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a7e48216-af3c-462e-a18e-6f19f21b3469 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.294181 Jun 23 11:58:20.820646 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 214/496] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:20 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 296 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:20.915163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:20.923474 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f9b0b3f0-798b-45f5-b041-c66b4f1666a1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.164659 Jun 23 11:58:20.924048 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 283/497] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:20 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:21.117346 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:21.117924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:21.124419 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.124986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.125773 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.126210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.330566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:21.341487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:21.346449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:21.347942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a090266c-5570-4440-bbe9-487bdfae3ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1738 microversion: 2.20 time: 0.235044 Jun 23 11:58:21.348631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 215/498] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:21 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1738 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:21.462512 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:21.463702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:21.474528 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.475258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.476039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.476467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.603143 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-5a592ed0-48b9-43b7-ac52-22e682d4fadc req-c2c009d1-7079-4f43-89d1-843945f5c778 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dde8e4-1b68-42be-ab9d-7a47869a6214", "tag": "1bf26417-9e61-446b-af12-0f2d3c6c3a6c"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:21.628390 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-5a592ed0-48b9-43b7-ac52-22e682d4fadc req-c2c009d1-7079-4f43-89d1-843945f5c778 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.629366 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-5a592ed0-48b9-43b7-ac52-22e682d4fadc req-c2c009d1-7079-4f43-89d1-843945f5c778 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.650894 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-5a592ed0-48b9-43b7-ac52-22e682d4fadc req-c2c009d1-7079-4f43-89d1-843945f5c778 service nova] Creating event network-changed:1bf26417-9e61-446b-af12-0f2d3c6c3a6c for instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 on hv-cinder-82660 Jun 23 11:58:21.657059 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-5a592ed0-48b9-43b7-ac52-22e682d4fadc req-c2c009d1-7079-4f43-89d1-843945f5c778 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.059970 Jun 23 11:58:21.659281 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 216/499] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:21.669111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:21.670098 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:21.679415 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.680036 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.681553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.682158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.779049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:21.790011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-465e42cc-bb76-429c-a968-41b1b915c6c8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1698 microversion: 2.1 time: 0.330682 Jun 23 11:58:21.790011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 284/500] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:21 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1698 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:21.814746 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cd7d13e4-ecc3-4fa0-959d-78e8fdca2016 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:21.823778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cd7d13e4-ecc3-4fa0-959d-78e8fdca2016 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:21.824234 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cd7d13e4-ecc3-4fa0-959d-78e8fdca2016 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:21.910447 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cd7d13e4-ecc3-4fa0-959d-78e8fdca2016 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Going to try to start instance {{(pid=117746) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 11:58:21.974788 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cd7d13e4-ecc3-4fa0-959d-78e8fdca2016 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action" status: 202 len: 0 microversion: 2.1 time: 0.169616 Jun 23 11:58:21.975453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 285/501] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:58:21 2022] POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action => generated 0 bytes in 171 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:58:21.988950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:21.990977 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:22.002224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.005790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.007715 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.008352 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.042339 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:22.205520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:22.207434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:22.220930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ba474202-dcfb-4926-bfa6-39003329c154 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.243601 Jun 23 11:58:22.221840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 286/502] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:21 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:22.226517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:22.227225 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:22.231231 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b9b8293e-31ef-4e72-aa73-f96540e48ddc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.569245 Jun 23 11:58:22.231231 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 217/503] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:21 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 571 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:22.235751 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.236228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:22.236456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.237078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:22.237581 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.238276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.243822 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.244308 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.245129 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.245567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.384695 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:22.385154 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:22.392616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-01996591-ee48-4f31-b758-1bd3bd74b63a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.169657 Jun 23 11:58:22.393221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ee23c3f9-f249-4048-88a9-69677f8b9992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.160825 Jun 23 11:58:22.393372 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 287/504] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:22 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:22.393870 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 218/505] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:22 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:22.399565 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:22.400848 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:22.407357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.407827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.408604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:22.409069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:22.548093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:22.558216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:22.559806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:22.561006 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bf265015-e716-4d58-8630-08b38ee34e52 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.165237 Jun 23 11:58:22.561575 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 288/506] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:22 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:23.241010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:23.241611 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:23.244738 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:23.248606 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:23.249269 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:23.249468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.249911 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.250677 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.251104 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.255260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.255711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.256477 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.257010 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.383255 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:23.384883 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:23.391282 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a1b196a9-24ee-4f6d-be68-6e4974074b24 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.156499 Jun 23 11:58:23.391837 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 219/507] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:23 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:23.393506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-47c937c2-876e-4441-95ca-73c897ce87b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.148712 Jun 23 11:58:23.394100 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 289/508] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:23 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:23.410934 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:23.411543 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:23.413586 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:23.414200 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:23.417714 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.418180 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.418993 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.419518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.420261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.420766 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.421913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.422350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.561593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:23.562183 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:23.569276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ee3383ae-d8d8-44d9-bd68-94b08aab0a8a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.159352 Jun 23 11:58:23.569780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-eeaf1607-4143-4ca0-99de-b6dc12de0c41 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.162521 Jun 23 11:58:23.569889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 290/509] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:23 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:23.570279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 220/510] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:23 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:23.583864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:23.584458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:23.590536 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.590981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.591726 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.592149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.726551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:23.734913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:23.736399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:23.737570 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4caf21f4-f78d-4034-9e4d-a0c1bf4c262e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.157641 Jun 23 11:58:23.738132 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 291/511] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:23 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:23.748730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-64250e4a-e474-4fa3-a787-bb1c375d5bb0 req-33593ebb-7f2e-4eba-b5b0-30a078e45587 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ec4d3-4ce1-4fbd-81ea-025a5c724421", "name": "network-vif-unplugged", "status": "completed", "tag": "8e9b4dc6-7a9c-4183-b1a8-10297c792e0e"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:23.758763 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-64250e4a-e474-4fa3-a787-bb1c375d5bb0 req-33593ebb-7f2e-4eba-b5b0-30a078e45587 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:23.760423 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-64250e4a-e474-4fa3-a787-bb1c375d5bb0 req-33593ebb-7f2e-4eba-b5b0-30a078e45587 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:23.771898 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-64250e4a-e474-4fa3-a787-bb1c375d5bb0 req-33593ebb-7f2e-4eba-b5b0-30a078e45587 service nova] Creating event network-vif-unplugged:8e9b4dc6-7a9c-4183-b1a8-10297c792e0e for instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 on hv-cinder-82660 Jun 23 11:58:23.776793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-64250e4a-e474-4fa3-a787-bb1c375d5bb0 req-33593ebb-7f2e-4eba-b5b0-30a078e45587 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032914 Jun 23 11:58:23.777386 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 221/512] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:24.408624 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:24.409177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:24.410091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:24.410799 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:24.416201 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.416650 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.417444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.417919 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.418170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.418620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.419387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.419819 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.559745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:24.559992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:24.567355 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-60833578-2603-4899-8dc7-1359c62664cf tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.162665 Jun 23 11:58:24.567846 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d28b6837-d7ce-4119-b5ed-c2f7aa1c4cba tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.161484 Jun 23 11:58:24.568821 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 222/513] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:24 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:24.568968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 292/514] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:24 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:24.587896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:24.588253 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:24.588702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:24.588914 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:24.595043 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.595313 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.595655 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.595762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.596486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.596607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.596965 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.597198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.734110 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:24.734545 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:24.741819 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2c10ed05-4389-4892-b83c-f367d9bd496a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.158396 Jun 23 11:58:24.742603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 223/515] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:24 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:24.742727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-57638212-dadd-4d6f-a336-6b3a14126f14 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.159270 Jun 23 11:58:24.743325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 293/516] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:24 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:24.756451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:24.757094 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:24.768092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.768544 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.769548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:24.770054 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:24.912145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:24.920397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:24.922131 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:24.923315 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-82e6b08d-5e47-4185-8cc0-446e29202e94 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.170708 Jun 23 11:58:24.923862 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 224/517] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:24 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:25.583168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:25.583840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:25.584223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:25.584327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:25.590428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.590728 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.590875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:25.591128 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:25.591655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.591923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.592123 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:25.592779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:25.773418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:25.781123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-93824e20-bfa4-4609-81c4-ac308b3c914e tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1314 microversion: 2.1 time: 0.201747 Jun 23 11:58:25.781717 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 294/518] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:25 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1314 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:25.786253 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:25.789971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:25.797592 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:25.811441 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.811804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:25.812588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.813050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:25.813220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9b93ae35-b133-4973-be08-0694de41e305 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.227618 Jun 23 11:58:25.814004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 225/519] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:25 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:25.818765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:25.823996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:25.835153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.835744 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:25.837433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:25.838469 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:26.179161 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:26.203159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-691c7b2a-c1b5-4e75-b9ca-0fdf38250881 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.387909 Jun 23 11:58:26.203943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 226/520] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:25 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 389 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:26.227392 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:26.228008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:26.234370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:26.234787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:26.235531 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:26.235710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:26.235975 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:26.243566 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-de195ecc-86d8-4695-b0fd-38084bdb96d6 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.460800 Jun 23 11:58:26.244747 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 295/521] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:25 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:26.397188 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:26.406591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:26.408132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:26.409299 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d790f17b-5804-458c-a56f-df05889921f3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.192135 Jun 23 11:58:26.409857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 227/522] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:26 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:26.799754 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:26.800476 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:26.808017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:26.808898 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:26.809539 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:26.810074 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:26.831428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:26.832036 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:26.839755 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:26.840331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:26.841143 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:26.841756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:26.952507 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:26.963804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8b17a4ef-9beb-4ab8-aaf1-a1ff73bb38db tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1463 microversion: 2.1 time: 0.168098 Jun 23 11:58:26.964394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 296/523] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:26 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1463 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:26.990513 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:26.998099 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e8dfefd1-6d09-453f-8a65-c14437006dd2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.171319 Jun 23 11:58:26.998670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 228/524] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:26 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:27.008727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:27.009262 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:27.015417 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.015865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.016626 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.017081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.042614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:58:27.119874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-16b1b003-fffe-45af-8741-8d3664f22dbb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "DELETE /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 204 len: 0 microversion: 2.1 time: 0.114041 Jun 23 11:58:27.120604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 297/525] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:58:27 2022] DELETE /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:58:27.128665 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:27.129285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:27.135312 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.135753 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.136527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.136987 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.221772 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:27.222620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:27.229455 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.230381 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.231426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.231872 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.282804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:27.290449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-186eabc7-8bf8-44d7-a338-ed27b0e61135 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.165549 Jun 23 11:58:27.291514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 229/526] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:27 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:27.297745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:27.298490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:27.304831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.305357 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.308523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.308523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.380929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:27.389176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cecf7131-7633-4c34-91de-d4e4804edc76 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.171498 Jun 23 11:58:27.389961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 298/527] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:27 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:27.428508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:27.429160 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:27.435998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.436464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.437544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:27.438015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:27.447691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:27.452053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:27.458420 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4846c99f-df62-4d96-8750-4f88a53bb8bf tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.164698 Jun 23 11:58:27.461109 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 230/528] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:27 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:27.577070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:27.585249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:27.586774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:27.588498 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0c9cf057-d8ec-4f6b-8b4b-22a5a14376c0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.164011 Jun 23 11:58:27.589118 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 299/529] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:27 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:28.015927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:28.016528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:28.023407 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.023854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.024604 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.025693 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.153560 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:28.160935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cb09e4cf-b90e-4b28-bf17-e6c60d1c3402 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.149050 Jun 23 11:58:28.161509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 231/530] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:28 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:28.308910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:28.309449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:28.316066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.316513 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.317314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.317756 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.405057 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:28.405706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:28.411841 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.412291 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.413092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.413525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.448840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:28.456535 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-75d62e46-3435-49de-8058-15609c0ccd82 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.152137 Jun 23 11:58:28.457239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 300/531] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:28 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:28.475387 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:28.476267 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:28.483747 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.484866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.485520 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.486105 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.491277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:28.554850 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:28.565406 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fba06696-50e2-4a03-842a-4f4c44b15c24 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.163909 Jun 23 11:58:28.565901 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 232/532] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:28 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:28.607368 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:28.608016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:28.614131 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.614578 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.615349 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:28.615791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:28.622876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:28.630336 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2b1bd9e3-4e44-4b82-88b5-fb3eb5ee5c07 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.158926 Jun 23 11:58:28.630902 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 301/533] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:28 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:28.743048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:28.751643 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:28.753176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:28.754332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-49befc31-65f5-48e7-8864-0e73c96af81e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.151429 Jun 23 11:58:28.754898 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 233/534] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:28 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:29.177411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:29.178016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:29.184446 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.184933 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.185703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.186134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.315888 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:29.324205 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-21062206-f366-4350-9b91-405520d720a4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.150690 Jun 23 11:58:29.324804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 302/535] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:29 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:29.472482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:29.473120 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:29.479712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.480170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.480992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.481607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.581733 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:29.582448 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:29.588768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.589321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.590179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.590688 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.615479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:29.623712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-eca404aa-4a0d-4869-8632-5226d2fe200f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.155034 Jun 23 11:58:29.624289 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 234/536] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:29 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:29.646863 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:29.647465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:29.653736 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.654173 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.654929 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.655363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.723795 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:29.732587 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5f18caed-3b26-4b40-b6af-64d0e7aa3f0c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.154706 Jun 23 11:58:29.733217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 303/537] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:29 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:29.772430 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:29.773061 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:29.779681 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.780129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.780923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:29.781355 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:29.787109 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:29.795257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c3e1623e-fcee-4f44-8836-5042f39a7a39 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.152145 Jun 23 11:58:29.795877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 235/538] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:29 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:29.916850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:29.925077 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:29.926582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:29.927732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-89168f63-b4e1-4de2-bd63-33738f8b8a3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.159210 Jun 23 11:58:29.928288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 304/539] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:29 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:30.340056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:30.340584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:30.346718 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.347164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.347956 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.348402 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.487808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:30.497881 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-80169a35-1d62-4349-9057-e423bc7f3c34 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.161670 Jun 23 11:58:30.504893 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 236/540] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:30 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:30.641543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:30.642143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:30.648046 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.648491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.649277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.649703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.749427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:30.750276 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:30.756457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.756936 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.757702 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.758130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.780543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:30.788217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7af61866-d4ae-4f6a-b30b-c8ec258565f4 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.151070 Jun 23 11:58:30.789007 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 305/541] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:30 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:30.811285 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:30.812026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:30.818207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.818655 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.819438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.819870 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.887132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:30.895170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ea6783fd-6027-469d-b8cc-2eb24a4f8f10 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.149557 Jun 23 11:58:30.895763 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 237/542] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:30 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:30.946102 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:30.947379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:30.953656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.954294 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.954937 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:30.955377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:30.956398 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:30.964767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2f041f40-7ca9-4eaf-bf58-131f2b52c6ce tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.157274 Jun 23 11:58:30.969200 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 306/543] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:30 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:31.098496 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:31.106762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:31.108272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:31.109455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bf7121c0-f3d4-4e6d-8f03-a85ee198846a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.167448 Jun 23 11:58:31.110016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 238/544] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:30 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:31.514873 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:31.515491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:31.521571 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.522019 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:31.522798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.523227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:31.649531 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:31.657236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9a1ea889-7a50-411a-90ca-d277023f1ce9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.146109 Jun 23 11:58:31.657869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 307/545] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:31 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:31.809591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:31.811326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:31.820845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.821338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:31.822141 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.822757 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:31.913645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:31.914255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:31.921118 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.921822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:31.922588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.923020 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:31.960445 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:31.970637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-131ef10a-c807-493a-9c3d-cf0728d22771 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.168738 Jun 23 11:58:31.971214 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 239/546] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:31 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:31.982847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:31.983531 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:31.989832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.990348 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:31.991177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:31.991703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:32.059358 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:32.067500 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f5980b21-9c22-4fd6-8f81-a5ac02a3482a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.157876 Jun 23 11:58:32.068305 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 308/547] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:31 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:32.124915 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:32.128315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:32.128961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:32.132765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2f55b0b8-c54f-40ea-9d87-262b4947f26a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.154374 Jun 23 11:58:32.133371 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 240/548] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:31 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:32.135275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:32.135686 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:32.136461 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:32.136971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:32.283928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:32.292525 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:32.294054 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:32.295214 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1396f06c-fc2d-4eb6-9ae8-82a64df82c95 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.170944 Jun 23 11:58:32.295773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 309/549] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:32 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:32.674794 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:32.675414 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:32.681946 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:32.682402 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:32.683192 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:32.683627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:32.825444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:32.833449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-35f14b00-40c6-44e9-b146-029f07e05ff0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.162577 Jun 23 11:58:32.834027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 241/550] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:32 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:32.988026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:32.988629 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:32.995210 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:32.995655 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:32.996410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:32.996877 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.084590 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:33.085243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:33.092204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.092651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.093461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.093891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.131621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:33.141029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c8923b2a-44fb-4bd3-9214-e42906d9a9ba tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.156673 Jun 23 11:58:33.141839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 310/551] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:32 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:33.151120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:33.152387 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:33.158760 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.159208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.159987 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.160547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.237952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:33.246826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-06de7400-395a-4835-a192-ae57594843c0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.166062 Jun 23 11:58:33.247641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 242/552] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:33 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:33.301191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:33.313650 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f3c0114e-308a-42eb-acdd-dc5935f4c12c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.167152 Jun 23 11:58:33.313894 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:33.314346 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:33.314562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 311/553] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:33 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:33.320758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.321204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.322019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.322444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.463587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:33.471464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:33.472976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:33.474114 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ea1c06be-5840-4a9b-b0c3-e5b584677e39 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.164330 Jun 23 11:58:33.474674 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 243/554] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:33 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:33.851035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:33.851667 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:33.857836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.858286 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.859048 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.859482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.882058 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:33.882553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:33.890014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.890396 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.891173 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:33.891606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:33.972590 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lazy-loading 'services' on Instance uuid b53cbaa7-867e-41fd-ae9d-437ed7dab927 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:58:33.990718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:33.998798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8bd0289a-cf20-42d1-9e83-ebf0272cd49e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.151659 Jun 23 11:58:33.999376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 312/555] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:33 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:34.044275 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1358c76b-8c9b-4212-8351-7de284824484 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927/os-volume_attachments/87bf0f9e-9371-477d-9d68-fba0362fbf49" status: 202 len: 0 microversion: 2.1 time: 0.165940 Jun 23 11:58:34.044902 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 244/556] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 11:58:33 2022] DELETE /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927/os-volume_attachments/87bf0f9e-9371-477d-9d68-fba0362fbf49 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 11:58:34.157873 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:34.158408 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:34.164466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.164952 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.165770 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.166208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.266304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:34.267707 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:34.274325 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.274769 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.275594 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.276113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.299995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:34.308189 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c37d6cdd-6105-4511-9f28-3d02bc4548e9 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.154249 Jun 23 11:58:34.317523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 313/557] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:34 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:34.336455 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:34.338176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:34.344275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.344758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.345534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.345971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.407740 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:34.416539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-29c7547b-5a02-4816-b55d-589a1ec6a981 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.156285 Jun 23 11:58:34.417076 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 245/558] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:34 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:34.475049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:34.484765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7be3c246-9437-4298-ab81-faf7582363b5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.152039 Jun 23 11:58:34.485431 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 314/559] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:34 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:34.492242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:34.492959 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:34.499150 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.499663 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.500421 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:34.500897 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:34.639366 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:34.642928 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:34.653528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:34.655606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:34.656809 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a703fdc0-20ca-451a-aea4-1ca0dd32caab tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.168387 Jun 23 11:58:34.667722 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 246/560] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:34 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:35.016397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:35.017030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:35.023608 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.024050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.024850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.025275 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.154757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:35.162312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a1dfc17a-2ac0-4ab7-805c-4fc2f057c907 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.149740 Jun 23 11:58:35.162889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 315/561] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:35 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:35.325437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:35.325953 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:35.334080 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.334577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.335352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.335791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.433767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:35.434462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:35.441177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.441730 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.442514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.442951 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.465378 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:35.473075 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2d3e6dbe-0184-4ac2-bed0-48dc56b28b86 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.151578 Jun 23 11:58:35.473647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 247/562] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:35 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:35.502980 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:35.503603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:35.510232 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.510683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.511814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.511997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.579635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:35.587996 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b2d68fc1-8de9-49b3-b5bc-de0c56d65fe6 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.158662 Jun 23 11:58:35.588529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 316/563] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:35 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:35.651044 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:35.658621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5a3412a6-3f8d-4a78-ad8e-005a80972503 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.159781 Jun 23 11:58:35.659201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 248/564] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:35 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:35.684050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:35.686372 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:35.688223 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:35.693189 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.693643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.694510 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:35.694851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:35.867852 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:35.871262 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:35.883159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:35.885678 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:35.887060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5a330e20-0448-4a38-bcde-839761813864 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1720 microversion: 2.20 time: 0.207268 Jun 23 11:58:35.898504 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 317/565] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:35 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1720 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:36.179239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:36.179815 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:36.186630 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.187081 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.187847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.188281 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.320379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:36.327845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c867a3ee-e5a8-419e-86cd-65de79fc5e6f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.152468 Jun 23 11:58:36.328420 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 249/566] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:36 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:36.491607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:36.492219 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:36.501354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.501811 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.502962 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.509049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.610303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:36.611024 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:36.617522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.617977 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.618784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.619324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.643690 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:36.651882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-33034a13-3283-4396-bb3b-d06a678ad695 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.164146 Jun 23 11:58:36.652554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 318/567] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:36 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:36.677607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:36.678291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:36.684896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.685301 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.686079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.686526 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.755722 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:36.764525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e22faa30-9380-464b-8148-a2c0dd7af72e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.158019 Jun 23 11:58:36.765155 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 250/568] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:36 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:36.814196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:36.822252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-84a93b76-7436-4dca-8980-a8521ef4c2df tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.150088 Jun 23 11:58:36.822911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 319/569] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:36 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:36.905925 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:36.906527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:36.912519 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.913004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:36.913758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:36.914193 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.042891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.051290 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.052829 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.054048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4516c306-7f26-43c0-ad48-a20d416f592d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1723 microversion: 2.20 time: 0.151990 Jun 23 11:58:37.054607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 251/570] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:36 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:37.072706 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c4656f35-5439-4f80-b8d6-c6eb8e02f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "15387896-7a48-41a8-b921-b4c09d99838f"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:37.073838 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c4656f35-5439-4f80-b8d6-c6eb8e02f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:37.079967 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4656f35-5439-4f80-b8d6-c6eb8e02f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.080405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4656f35-5439-4f80-b8d6-c6eb8e02f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.081188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4656f35-5439-4f80-b8d6-c6eb8e02f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.081616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4656f35-5439-4f80-b8d6-c6eb8e02f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.345302 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:37.346529 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:37.352562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.353177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.354236 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.354804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.420436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c4656f35-5439-4f80-b8d6-c6eb8e02f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.352126 Jun 23 11:58:37.422203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 320/571] 10.222.0.67 () {62 vars in 1363 bytes} [Thu Jun 23 11:58:37 2022] POST /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments => generated 188 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 11:58:37.511696 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.519260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5d91d01b-fbea-44d8-8035-c14d386f5a12 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.178169 Jun 23 11:58:37.519832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 252/572] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:37 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:37.544458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2b19a154-6319-4df6-82ab-83ac3bc7c7d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:37.545057 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2b19a154-6319-4df6-82ab-83ac3bc7c7d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:37.553550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b19a154-6319-4df6-82ab-83ac3bc7c7d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.553550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b19a154-6319-4df6-82ab-83ac3bc7c7d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.554239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b19a154-6319-4df6-82ab-83ac3bc7c7d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.554697 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b19a154-6319-4df6-82ab-83ac3bc7c7d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.647347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2b19a154-6319-4df6-82ab-83ac3bc7c7d9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/action" status: 202 len: 0 microversion: 2.20 time: 0.107277 Jun 23 11:58:37.648131 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 321/573] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 23 11:58:37 2022] POST /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:58:37.669156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:37.670048 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:37.672942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:37.673750 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:37.678103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.678561 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.679380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.679791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.683577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.684248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.687060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.687757 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.847859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.859611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1af7222e-fdf6-4837-8a5b-eacbd1c36ed6 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.194999 Jun 23 11:58:37.860871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 322/574] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:37 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:37.864293 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.866456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:37.866848 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:37.873539 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.874124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.875023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.875548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.879572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.881648 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:37.883019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-649f8cf9-8334-401c-bb89-edce51f12926 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.230862 Jun 23 11:58:37.883728 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 253/575] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:37 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:37.890270 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:37.891089 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:37.898518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.899322 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:37.901005 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:37.901401 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:38.045876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:38.054534 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:38.060043 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fd269269-6c60-4114-b3c4-7d805b0a2198 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.198024 Jun 23 11:58:38.060735 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 323/576] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:37 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:38.067037 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6de6beec-9609-4c2e-bb67-0085ad5ff62c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.181830 Jun 23 11:58:38.067813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 254/577] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:37 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:38.538092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:38.538618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:38.545658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:38.546785 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:38.547051 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:38.547759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:38.701805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:38.710901 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a93b0838-6001-4b88-8880-53e280b53f76 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.177857 Jun 23 11:58:38.711483 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 324/578] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:38 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:38.876119 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:38.876760 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:38.883224 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:38.883677 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:38.885136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:38.885576 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:38.902754 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:38.903445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:38.910217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:38.910993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:38.911870 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:38.912371 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:39.035686 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:39.043660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-172e132f-626b-4152-818d-a7b81161d81b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.171424 Jun 23 11:58:39.044237 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 255/579] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:38 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:39.062568 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:39.071217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:39.072884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:39.074061 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6fad8eda-4762-4704-a2d0-b56622e80a22 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.175516 Jun 23 11:58:39.074621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 325/580] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:38 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:39.076370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:39.077010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:39.082838 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:39.083336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:39.083446 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:39.083786 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:39.084558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:39.085029 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:39.089493 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:39.089938 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:39.090719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:39.091151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:39.221848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:39.224544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:39.230463 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e14099bf-5c5e-45d0-80ad-4ba184fb865d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.157870 Jun 23 11:58:39.231041 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 256/581] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:39 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:39.232575 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-dd9ebf6b-420f-4b00-add9-953df0ae682d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.153312 Jun 23 11:58:39.233182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 326/582] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:39 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:39.726946 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:39.727547 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:39.734150 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:39.734585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:39.735333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:39.735760 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:39.862586 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:39.870628 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-11cc405a-5a10-403c-825a-14665a82374c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.147528 Jun 23 11:58:39.871124 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 257/583] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:39 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:40.060853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:40.061464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:40.068174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.068629 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.069463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.069902 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.091719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:40.092463 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:40.098875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.099317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.100078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.100501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.212171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:40.224603 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1033286b-70cd-4f19-a8f3-b8c6dc1a142f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.167287 Jun 23 11:58:40.224603 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 327/584] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:40 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:40.247519 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:40.248466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:40.255798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.256528 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.257531 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.257957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.259375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:40.268293 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:40.269909 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:40.271081 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2a6ab44a-a409-42d9-94ae-e89a4efb107b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.183740 Jun 23 11:58:40.281582 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 258/585] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:40 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:40.286757 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:40.287378 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:40.294258 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.294986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.295771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.296208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.402238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:40.411887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-dfe461f6-1df3-4279-974b-a9f472ac869a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.168326 Jun 23 11:58:40.412806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 328/586] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:40 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:40.419813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-847bfd26-2b92-4488-971a-7575c2c1ffa3 req-c5470b42-9a44-4b5b-92d4-7d58f1896ac9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dde8e4-1b68-42be-ab9d-7a47869a6214", "name": "network-vif-plugged", "status": "completed", "tag": "1bf26417-9e61-446b-af12-0f2d3c6c3a6c"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:40.428244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-847bfd26-2b92-4488-971a-7575c2c1ffa3 req-c5470b42-9a44-4b5b-92d4-7d58f1896ac9 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.429098 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-847bfd26-2b92-4488-971a-7575c2c1ffa3 req-c5470b42-9a44-4b5b-92d4-7d58f1896ac9 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.442581 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:40.444002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-847bfd26-2b92-4488-971a-7575c2c1ffa3 req-c5470b42-9a44-4b5b-92d4-7d58f1896ac9 service nova] Creating event network-vif-plugged:1bf26417-9e61-446b-af12-0f2d3c6c3a6c for instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 on hv-cinder-82660 Jun 23 11:58:40.450708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-847bfd26-2b92-4488-971a-7575c2c1ffa3 req-c5470b42-9a44-4b5b-92d4-7d58f1896ac9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036115 Jun 23 11:58:40.451905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 329/587] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:40.452743 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-25ae32c5-06e8-45f1-baac-d7554b647c7a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.169759 Jun 23 11:58:40.453315 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 259/588] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:40 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:40.887555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:40.888267 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:40.895194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.895672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:40.896444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:40.896909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.029304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:41.036798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2a3c000e-25af-484f-bbd0-a53fa25f34c8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.154163 Jun 23 11:58:41.037373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 330/589] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:40 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:41.241654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:41.242171 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:41.249399 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.249837 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.250590 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.251017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.289573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:41.290241 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:41.297350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.297795 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.298557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.298989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.314649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:41.381683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:41.389352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7344efbd-cc9f-460f-bd07-1cd0e973917b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.151594 Jun 23 11:58:41.389916 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 260/590] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:41 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:41.429910 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:41.430554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:41.436140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:41.437424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.437867 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.438636 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.439066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.444660 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:41.446203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:41.447422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1f1093fd-3ef9-4828-a730-0828166e7606 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.161660 Jun 23 11:58:41.447984 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 331/591] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:41 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:41.468312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:41.469055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:41.475158 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.475694 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.476537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:41.477026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:41.573998 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:41.582133 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-aca4dd07-30f6-46d1-bcc0-dc3c7e157247 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.156082 Jun 23 11:58:41.582708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 261/592] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:41 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:41.612212 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:41.619634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e5bb5845-24e8-4f39-a515-add6592fc666 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.154995 Jun 23 11:58:41.620196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 332/593] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:41 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:42.053471 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:42.054078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:42.060160 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.060610 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.061402 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.061835 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.188375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:42.195836 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4fd550de-c4e8-4238-89ac-d8ed8af49e82 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.146259 Jun 23 11:58:42.196392 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 262/594] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:42 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:42.406397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:42.406909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:42.413692 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.414144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.414911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.415345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.464823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:42.465442 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:42.472001 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.472452 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.473251 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.473694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.492336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:42.552766 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:42.561053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6bf04820-4101-4a94-8dde-23dcac431d59 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.158532 Jun 23 11:58:42.561839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 333/595] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:42 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:42.565997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-27b5efe7-3599-4e9e-8d12-62df734a8629 req-9784a0b2-1a16-4dcc-8c4f-1ebe5b3b1afd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a64ae5-5786-41de-9862-e321b902937a", "name": "network-vif-plugged", "status": "completed", "tag": "fe3999d6-abf8-455b-97de-e88dd06b7caa"}, {"server_uuid": "567ad1bf-ef6b-41f9-800f-f589f136a1b6", "name": "network-vif-unplugged", "status": "completed", "tag": "eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:42.576528 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-27b5efe7-3599-4e9e-8d12-62df734a8629 req-9784a0b2-1a16-4dcc-8c4f-1ebe5b3b1afd service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.577100 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-27b5efe7-3599-4e9e-8d12-62df734a8629 req-9784a0b2-1a16-4dcc-8c4f-1ebe5b3b1afd service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.591765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-27b5efe7-3599-4e9e-8d12-62df734a8629 req-9784a0b2-1a16-4dcc-8c4f-1ebe5b3b1afd service nova] Creating event network-vif-plugged:fe3999d6-abf8-455b-97de-e88dd06b7caa for instance b2a64ae5-5786-41de-9862-e321b902937a on hv-cinder-82660 Jun 23 11:58:42.592374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-27b5efe7-3599-4e9e-8d12-62df734a8629 req-9784a0b2-1a16-4dcc-8c4f-1ebe5b3b1afd service nova] Creating event network-vif-unplugged:eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3 for instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 on hv-cinder-82660 Jun 23 11:58:42.601857 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-27b5efe7-3599-4e9e-8d12-62df734a8629 req-9784a0b2-1a16-4dcc-8c4f-1ebe5b3b1afd service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 356 microversion: 2.1 time: 0.036658 Jun 23 11:58:42.601857 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 334/596] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:42 2022] POST /compute/v2.1/os-server-external-events => generated 356 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:42.607787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:42.608506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:42.615088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.615530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.616286 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.616725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.627298 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:42.639279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:42.642501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:42.643945 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a7c8eea5-5bf8-44ef-980b-574c385f9355 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.183212 Jun 23 11:58:42.644498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 263/597] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:42 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:42.649021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:42.649617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:42.655782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.656500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.657231 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:42.657661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:42.758743 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:42.767317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b0dfaeef-4f81-4073-9c42-42143b5746de tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.164423 Jun 23 11:58:42.767911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 335/598] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:42 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:42.794248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:42.801953 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b1ed84a3-5376-4bd8-a912-ce0b4d799918 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.156490 Jun 23 11:58:42.802505 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 264/599] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:42 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:43.213867 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:43.214530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:43.220621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.221099 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.221856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.222291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.349334 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:43.357321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-dd2d9363-92d8-4cc4-9058-8266cadec0c7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.147841 Jun 23 11:58:43.357893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 336/600] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:43 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:43.577465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:43.578065 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:43.584547 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.585016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.585765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.586195 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.664194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:43.664930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:43.673265 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.673719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.674499 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.674935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.719574 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:43.727384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c06b5fa9-44ec-46ff-a2cf-9c134f4aabb3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.153512 Jun 23 11:58:43.727841 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 265/601] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:43 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:43.784587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:43.785229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:43.791275 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.791725 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.792502 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.793003 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.809704 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:43.818728 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:43.820206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:43.821415 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-569c75f4-71a9-4f8c-9ce1-860ea80d15d8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.161288 Jun 23 11:58:43.822551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 337/602] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:43 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:43.826896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:43.827554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:43.833491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.833935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.834698 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:43.835190 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:43.930784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:43.939148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bff0bba7-c431-4960-9d79-16069fa8e134 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.158372 Jun 23 11:58:43.939916 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 266/603] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:43 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:43.968927 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:43.976276 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-65cb9f5a-c88b-4916-aff7-abe40a90e3cb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.152791 Jun 23 11:58:43.976864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 338/604] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:43 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:44.373979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:44.374592 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:44.380739 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.381189 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.381979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.382415 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.528224 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:44.537545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-536eef83-e576-4ac7-8ba1-8bede66d5d5b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.167297 Jun 23 11:58:44.538195 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 267/605] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:44 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:44.745035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:44.745533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:44.752155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.752791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.753567 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.754007 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.840034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:44.840650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:44.847622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.848077 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.848885 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.849323 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.890926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:44.898577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-31e1b4de-f894-4311-bfa4-b6faf196a1ea tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.158122 Jun 23 11:58:44.899159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 339/606] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:44 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:44.955310 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:44.955921 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:44.961998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.962508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.963282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:44.963718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:44.981806 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:44.990889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:44.992399 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:44.994186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-33d84353-9e3f-4a05-aab5-772313856f3f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.157530 Jun 23 11:58:44.994746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 268/607] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:44 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:44.999275 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:44.999877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:45.002840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:45.006319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:45.006756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:45.007542 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:45.007976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:45.093247 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:45.101390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e9439ca5-d47d-484c-953f-8545fb459b7f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.149910 Jun 23 11:58:45.101980 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 340/608] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:44 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:45.137632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:45.145103 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5861d0cd-9063-4284-b664-aa43509c8ab2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.149372 Jun 23 11:58:45.145672 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 269/609] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:44 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:45.554784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:45.555401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:45.561551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:45.562002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:45.562792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:45.563229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:45.704414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:45.711895 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-88426624-701c-4b8f-9ee7-5723660299c9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.161212 Jun 23 11:58:45.713179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 341/610] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:45 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:45.915307 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:45.915848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:45.922917 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:45.923368 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:45.924151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:45.925798 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.012815 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:46.013429 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:46.020022 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.020471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.021285 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.021721 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.057139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:46.064886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f99b77e3-b050-494c-be80-9ed0bffcdffb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.153496 Jun 23 11:58:46.065466 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 270/611] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:45 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:46.119520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:46.120131 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:46.126133 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.126608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.127378 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.127816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.152611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:46.162467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:46.163971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:46.165169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5c253bbb-6635-4f52-ad96-fea594e4c38c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.156812 Jun 23 11:58:46.165854 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 342/612] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:46 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:46.170271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:46.170896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:46.177148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.177598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.178367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.178802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.258749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:46.271668 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-44a65aa7-81b6-441a-b30c-b87ef74b6a44 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.156037 Jun 23 11:58:46.272729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 271/613] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:46 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:46.318526 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:46.326472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0d100cdd-c175-4d8b-aa47-6a1b87ad4238 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.159736 Jun 23 11:58:46.327036 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 343/614] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:46 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:46.729635 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:46.730238 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:46.736224 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.736685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.737450 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:46.737880 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:46.875981 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:46.883358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ba01c18e-daf1-464e-8eff-dd243cc664ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.157587 Jun 23 11:58:46.884041 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 272/615] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:46 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:47.082347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:47.082948 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:47.089780 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.090224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.090978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.091426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.183874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:47.184699 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:47.191689 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.192156 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.192959 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.193401 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.225619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:47.234356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1cd59f09-c00d-4a31-846e-b70c37436386 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.155745 Jun 23 11:58:47.235053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 344/616] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:47 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:47.296824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:47.299927 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:47.303731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.304260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.305161 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.305665 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.328187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:47.336908 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:47.338632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:47.339813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e3ba31f0-8a19-4938-ade8-ec06a568c306 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.160508 Jun 23 11:58:47.340373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 273/617] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:47 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:47.344999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:47.345472 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:47.354130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.354583 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.355365 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.355954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.440241 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:47.450287 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bedf6fdc-8748-4d92-9b88-546d843192e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.157499 Jun 23 11:58:47.450873 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 345/618] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:47 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:47.488220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:47.496398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-56e61c75-9a95-4ec7-9ded-8e69a8a8aee9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.154987 Jun 23 11:58:47.496998 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 274/619] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:47 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:47.901163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:47.901759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:47.907951 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.908393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:47.909167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:47.909591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.040904 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:48.048793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-62ee272a-a078-4d3b-a0e3-50cb30c6cf4d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.152213 Jun 23 11:58:48.049361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 346/620] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:47 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:48.252201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:48.252865 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:48.259992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.260445 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.261243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.261683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.358003 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:48.358693 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:48.365353 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.365881 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.366642 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.367065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.395875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:48.403555 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9c24bb1f-db00-4369-9444-8f44467fb45d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.155236 Jun 23 11:58:48.404127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 275/621] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:48 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:48.468606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:48.469304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:48.475247 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.475696 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.476461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.476920 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.499563 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:48.508076 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:48.510198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:48.511381 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b8ca0b17-a8aa-4b2c-bef7-38b9061af095 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.157306 Jun 23 11:58:48.511944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 347/622] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:48 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:48.516573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:48.517199 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:48.523621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.524263 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.525095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:48.525536 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:48.610126 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:48.618319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-514eb2f4-da11-4a7a-a1c3-1ab960e11a91 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.153518 Jun 23 11:58:48.619468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 276/623] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:48 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:48.658039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:48.660830 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:48.668183 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4526ed2a-2ab8-4a70-a974-90a0f5d73c29 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.155084 Jun 23 11:58:48.668781 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 348/624] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:48 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:49.065567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:49.066177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:49.072232 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.072719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.073487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.073923 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.201322 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:49.208729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f8fbb972-f175-4673-a86b-2b181b413784 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.147022 Jun 23 11:58:49.209288 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 277/625] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:49 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:49.422325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:49.422972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:49.429626 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.430081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.430850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.431288 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.530048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:49.530650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:49.537568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.538005 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.538771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.539206 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.565171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:49.573166 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b682be29-630f-4a04-8ea4-8429cb64863a tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.156057 Jun 23 11:58:49.573759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 349/626] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:49 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:49.636113 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:49.636894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:49.643328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.643874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.644668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.645124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.783115 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:49.791330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bf0ee4f4-5f3e-4f01-b2ac-2558167192a0 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.159709 Jun 23 11:58:49.791928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 350/627] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:49 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:49.796411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:49.797308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:49.803508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.803960 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.804753 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:49.805188 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:49.901467 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:49.909732 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:49.911228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:49.912390 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1da2de1e-ebda-42f7-8ccd-7f4b6f28f88c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.386194 Jun 23 11:58:49.912980 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 278/628] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:49 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:49.944002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:49.953419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-30fc373a-65d8-4e41-9cb7-aca504d3bfe8 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.160493 Jun 23 11:58:49.953992 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 351/629] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:49 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:50.225800 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:50.226418 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:50.233826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.234302 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.235107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.235542 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.363280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:50.371292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-da2705ff-d07e-49ff-8a43-ab43c5b69769 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.149313 Jun 23 11:58:50.371855 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 279/630] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:50 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:50.590674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:50.591243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:50.597887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.598344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.599119 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.599557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.730428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:50.737843 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7e0bb366-a3c7-4f0a-90d7-7216ac38a89c tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.151685 Jun 23 11:58:50.738454 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 352/631] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:50 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:50.807638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:50.808239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:50.814716 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.815158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.815920 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.816354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.820230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:50.930815 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:50.931533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:50.937544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.938070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.938920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.939426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.952154 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:50.960227 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0da109b0-55da-4e31-9dbd-a8e3cb8bfd3c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.156288 Jun 23 11:58:50.960656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 280/632] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:50 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:50.971181 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:50.971790 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:50.978380 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.978894 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:50.979662 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:50.980091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.078431 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:51.086985 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:51.089143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:51.090317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-770f6b66-c42b-40a2-9b98-6c17492af0fb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.163564 Jun 23 11:58:51.090887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 353/633] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:50 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:51.113745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:51.121099 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4e9cf425-2852-4c6e-9325-ea9d1babe3f9 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.155038 Jun 23 11:58:51.121661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 281/634] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:50 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:51.387944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:51.388546 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:51.394655 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.395095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.395847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.396272 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.523714 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-75d9eb14-49cf-4be8-a93d-a0026a1cf440 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8ecaf2b7-aeee-4a22-828c-f793fd65175b"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:51.524890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-75d9eb14-49cf-4be8-a93d-a0026a1cf440 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:51.529797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:51.531244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75d9eb14-49cf-4be8-a93d-a0026a1cf440 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.531701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75d9eb14-49cf-4be8-a93d-a0026a1cf440 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.532486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75d9eb14-49cf-4be8-a93d-a0026a1cf440 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.533030 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75d9eb14-49cf-4be8-a93d-a0026a1cf440 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.538403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-500d7519-65fe-43a0-9b57-84004fdaf2b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.154883 Jun 23 11:58:51.538993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 354/635] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:51 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:51.754938 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:51.755617 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:51.762191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.762633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.763406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.763835 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.897616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:51.906148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8a52dd99-6149-4a76-83c7-83961175cadb tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.155044 Jun 23 11:58:51.906719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 355/636] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:51 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:51.976861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:51.977592 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:51.984151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.984657 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:51.985440 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:51.985868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.118242 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:52.126401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-256f7b72-7185-451d-a424-d8ffe50a1b4b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.153508 Jun 23 11:58:52.126969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 356/637] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:51 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:52.131495 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:52.132130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:52.137995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.138445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.139215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.139649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.270770 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:52.279916 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:52.281466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:52.282631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1a973155-2366-435e-8ae3-cd3cf0adbb58 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.154722 Jun 23 11:58:52.283190 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 357/638] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:52 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:52.287622 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:52.288224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:52.294913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.295366 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.296159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.296856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.426761 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:52.434280 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7db6708e-4fb6-45d2-8955-82a6d77dbf40 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.150120 Jun 23 11:58:52.434844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 358/639] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:52 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:52.555283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:52.555901 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:52.561934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.562376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.563124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.563551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.693749 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:52.701966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-983764a5-5546-4c35-940b-29c666368bf5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.150470 Jun 23 11:58:52.702544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 359/640] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:52 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:52.923596 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:52.924224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:52.930553 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.930994 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:52.932249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:52.932700 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.062947 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:53.070497 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b89e3264-194a-4ea8-a5f1-5d84a1b98a8d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.151073 Jun 23 11:58:53.071071 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 360/641] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:52 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:53.143258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:53.143869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:53.150418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.150847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.151612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.152066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.286793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:53.294687 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4bc5034e-f98d-4eea-b303-98b8b92073be tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.155381 Jun 23 11:58:53.295274 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 361/642] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:53 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:53.301163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:53.301768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:53.307638 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.308087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.308907 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.309341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.436390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:53.445266 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:53.447244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:53.448437 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b6c593b9-0fa3-463a-8261-66f0e1647dfb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1809 microversion: 2.20 time: 0.150880 Jun 23 11:58:53.449031 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 362/643] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:53 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1809 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:53.453447 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:53.454059 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:53.460169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.460626 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.461424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.461859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.593710 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:53.601170 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8931ca30-1285-479d-82fd-83afb4c3752d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.151186 Jun 23 11:58:53.601745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 363/644] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:53 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:53.718789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:53.719413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:53.725508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.725963 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.726725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:53.727159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:53.859897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:53.867338 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2cab5322-9bbf-422a-8f58-da533e6ee936 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.152550 Jun 23 11:58:53.867912 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 364/645] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:53 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:54.086571 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:54.087228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:54.093677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.094132 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.094886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.095319 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.110524 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:54.234285 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:54.245253 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-819304ac-c342-4b4d-853d-9fe708635a01 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1469 microversion: 2.1 time: 0.162299 Jun 23 11:58:54.245752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 365/646] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:54 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1469 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:54.313189 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:54.313816 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:54.317249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:54.331281 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.332569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.338797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.339250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.502561 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-75d9eb14-49cf-4be8-a93d-a0026a1cf440 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.982543 Jun 23 11:58:54.514409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 282/647] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:58:51 2022] POST /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments => generated 194 bytes in 2995 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:58:54.533221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:54.536062 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:54.554591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.556513 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.559785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.560533 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.687228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:54.701366 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-294eb889-0dd6-4b4c-9c85-3c7ce56805f5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.392203 Jun 23 11:58:54.702984 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 366/648] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:54 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 395 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:54.708369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:54.709586 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:54.717485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.718211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.719781 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.720569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.932073 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:54.939630 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-053b4cf5-86bd-4b89-9c45-03ff5f230791 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.235305 Jun 23 11:58:54.940212 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 367/649] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:54 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:54.944881 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:54.945406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:54.951706 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.952152 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.952948 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:54.953387 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:54.966905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:54.976198 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:54.977830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:54.979086 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-24beac4b-5561-45cf-8597-29fafb33db25 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1749 microversion: 2.20 time: 0.462913 Jun 23 11:58:54.979775 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 283/650] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:54 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1749 bytes in 465 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:55.093824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:55.102472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-60ed44ee-7fb5-4ecb-b60c-5b7569d1545d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.161202 Jun 23 11:58:55.103443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 368/651] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:54 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:55.206841 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-f19f9637-88db-4d1b-9ae8-93aa0bc170fb req-27e38081-2b6a-4709-a7a5-aecd52eaa105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "567ad1bf-ef6b-41f9-800f-f589f136a1b6", "name": "network-vif-deleted", "tag": "eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:55.225935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f19f9637-88db-4d1b-9ae8-93aa0bc170fb req-27e38081-2b6a-4709-a7a5-aecd52eaa105 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.229493 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f19f9637-88db-4d1b-9ae8-93aa0bc170fb req-27e38081-2b6a-4709-a7a5-aecd52eaa105 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.262735 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:55.264205 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:55.277266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-f19f9637-88db-4d1b-9ae8-93aa0bc170fb req-27e38081-2b6a-4709-a7a5-aecd52eaa105 service nova] Creating event network-vif-deleted:eb9b3f74-0dd2-4cc7-82cc-8329fe4585a3 for instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 on hv-cinder-82660 Jun 23 11:58:55.280622 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.284025 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.286907 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.287740 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.298058 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-f19f9637-88db-4d1b-9ae8-93aa0bc170fb req-27e38081-2b6a-4709-a7a5-aecd52eaa105 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.084111 Jun 23 11:58:55.301377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 284/652] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:55.372418 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:55.373088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:55.376425 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:55.380104 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.380808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.381763 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.382618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.385472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6c04b3f8-43e2-4e37-8d4b-5c05b94c596f tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1427 microversion: 2.1 time: 0.127670 Jun 23 11:58:55.392605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 369/653] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:55 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1427 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:55.408752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:58:55.493187 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5cab3f24-032f-44d9-ba46-a0e5e74fdfab tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 204 len: 0 microversion: 2.1 time: 0.125545 Jun 23 11:58:55.494404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 285/654] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:58:55 2022] DELETE /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 11:58:55.502453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:55.503069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:55.509206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.510357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.511136 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.511573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.725069 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:55.726397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:55.738905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.739733 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.741182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.741991 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.757566 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:55.766095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a3ff7885-ddf4-499e-8e46-5d5a98514eb5 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1513 microversion: 2.1 time: 0.267367 Jun 23 11:58:55.766683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 370/655] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:55 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1513 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:55.879910 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:55.887783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-03d316b8-37bb-42ac-9b22-035fb58fc14a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.171124 Jun 23 11:58:55.888347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 286/656] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:55 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:55.956816 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:55.957423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:55.963935 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.964380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.965167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:55.965599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:55.998135 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:55.998750 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:56.004893 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.005351 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.006117 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.006556 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.097540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:56.105633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4bab64e9-375c-44b1-a51e-6e7edf7788c4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.152695 Jun 23 11:58:56.106399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 371/657] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:55 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:56.119111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:56.119615 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:56.125722 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.126604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.126922 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.127346 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.136125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:56.149664 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:56.151733 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:56.152932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c00a81e2-6640-4fc2-9d06-68e84dd3320f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1751 microversion: 2.20 time: 0.158720 Jun 23 11:58:56.153718 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 287/658] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:55 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1751 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:56.268309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:56.276362 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5c7b064d-3e5a-474e-a5f2-f396c158678d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1367 microversion: 2.1 time: 0.161026 Jun 23 11:58:56.276964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 372/659] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:56 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:56.402194 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:56.402804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:56.409266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.409662 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.410418 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.410848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.477749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:56.485776 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8efdbe13-c6b5-40f7-b62a-6cf72f4b6f61 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1299 microversion: 2.1 time: 0.087920 Jun 23 11:58:56.486629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 288/660] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:56 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1299 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:56.783740 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:56.784353 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:56.791438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.791893 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.792661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.793121 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.904594 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:56.905227 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:56.911585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.912040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.912854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:56.913296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:56.922158 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:56.929785 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c95e2b78-1473-4b66-9d37-31f527bca08a tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1513 microversion: 2.1 time: 0.150128 Jun 23 11:58:56.930365 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 373/661] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:56 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1513 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:57.041902 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:57.050116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-18bfd322-39e6-476e-a764-901bbba720d5 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.149328 Jun 23 11:58:57.050688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 289/662] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:56 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:57.122252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:57.122840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:57.128841 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.129282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.130028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.130451 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.171159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:57.171930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:57.177939 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.178381 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.179145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.179570 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.270337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:57.278601 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-13adb0cb-f4d3-418b-ab45-a52228e4dc68 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1357 microversion: 2.1 time: 0.160125 Jun 23 11:58:57.279182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 374/663] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:57 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1357 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:57.293247 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:57.293977 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:57.300509 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.301005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.301776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.302215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.315657 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:57.324562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:57.326109 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:57.327247 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-89c37fc9-cd50-46ae-9ac1-cde7d285f890 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1751 microversion: 2.20 time: 0.159983 Jun 23 11:58:57.328053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 290/664] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:57 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1751 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:58:57.429057 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:57.436986 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e2fa7a3f-b38f-43b7-9eff-87aa9e7847a7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1558 microversion: 2.1 time: 0.147587 Jun 23 11:58:57.437556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 375/665] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:57 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1558 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:57.453932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b49c3816-41ff-412e-b487-e8acd4aa0767 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:57.454423 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b49c3816-41ff-412e-b487-e8acd4aa0767 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:57.460828 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49c3816-41ff-412e-b487-e8acd4aa0767 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.461278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49c3816-41ff-412e-b487-e8acd4aa0767 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.462038 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49c3816-41ff-412e-b487-e8acd4aa0767 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.462499 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49c3816-41ff-412e-b487-e8acd4aa0767 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.508828 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:57.510102 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:57.516203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.516926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.517851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.518436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.554751 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b49c3816-41ff-412e-b487-e8acd4aa0767 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.104486 Jun 23 11:58:57.555397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 291/666] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 11:58:57 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a/os-interface => generated 285 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:57.598660 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:57.607777 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c0f9e82a-948b-44f5-a2aa-a3768a744774 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1299 microversion: 2.1 time: 0.102739 Jun 23 11:58:57.608602 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 376/667] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:57 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:57.946677 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:57.947292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:57.953326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.953771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:57.954538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:57.954971 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.067462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:58.068009 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:58.074550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.075005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.075781 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.076239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.210441 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.221394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1229c1b4-8047-442b-8160-1dea4321c8d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.157808 Jun 23 11:58:58.229081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 377/668] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:58 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:58.295583 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:58.296207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:58.303176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.303623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.304408 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.304877 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.443116 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.451444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4f743b37-a925-484e-a2ae-dd892f00d94f tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1546 microversion: 2.1 time: 0.159850 Jun 23 11:58:58.452032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 378/669] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:58 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1546 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:58.456547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:58.457350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:58.463498 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.463952 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.464756 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.465192 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.562550 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.570331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0a1a63ae-fbbb-491a-b6e6-a1867faf8330 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1513 microversion: 2.1 time: 0.627530 Jun 23 11:58:58.570993 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 292/670] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:57 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1513 bytes in 629 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:58.575708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:58.576387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:58.582580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.583254 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.584885 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.585362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.605964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.615264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.616809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.618179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-aec2965a-43e2-440a-b28e-1feb58dc7c69 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1751 microversion: 2.20 time: 0.165193 Jun 23 11:58:58.619355 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 379/671] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:58 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1751 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:58:58.626880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:58.627744 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:58.634217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.634694 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.635440 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.635874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.675530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.676327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.676821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lazy-loading 'fault' on Instance uuid 567ad1bf-ef6b-41f9-800f-f589f136a1b6 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:58:58.730358 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.742875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cbb5a14d-89b2-4e4c-bdfe-4bb423e98e3b tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1304 microversion: 2.1 time: 0.119431 Jun 23 11:58:58.749143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 380/672] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:58 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1304 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:58.863295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.870798 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-45c7d642-50e9-4fa8-8a46-2c7db3a81530 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1546 microversion: 2.1 time: 0.298586 Jun 23 11:58:58.871363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 293/673] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:58 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1546 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:58.949341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:58.953030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:58.953814 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Searching by: {'deleted': False, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3'} {{(pid=117746) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 23 11:58:58.966889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.967169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:58.967760 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:58.968193 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.067292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.multi_cell_list [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=117746) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 23 11:58:59.093600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:59.163387 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5146d70c-3210-4b63-8a2b-b35fe3a94ab5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers" status: 200 len: 342 microversion: 2.1 time: 0.217862 Jun 23 11:58:59.163966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 381/674] 10.222.0.67 () {58 vars in 1124 bytes} [Thu Jun 23 11:58:58 2022] GET /compute/v2.1/servers => generated 342 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:59.174827 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:59.175431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:59.181467 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.181908 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.182661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.183088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.239267 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:59.240011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:59.247044 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.247342 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.248134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.248555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.378169 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:59.382001 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:58:59.387324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0fd6a6d6-fa8a-4136-902b-3db2b74cd181 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1546 microversion: 2.1 time: 0.216426 Jun 23 11:58:59.388229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 294/675] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:59 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1546 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:59.392921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-3ba90ede-6547-4369-8d2e-160aef89e7ab req-f05b95c0-d237-4185-84bb-90f83bf478ad service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b2a64ae5-5786-41de-9862-e321b902937a", "tag": "fe3999d6-abf8-455b-97de-e88dd06b7caa"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:58:59.402568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-3ba90ede-6547-4369-8d2e-160aef89e7ab req-f05b95c0-d237-4185-84bb-90f83bf478ad service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.403211 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-3ba90ede-6547-4369-8d2e-160aef89e7ab req-f05b95c0-d237-4185-84bb-90f83bf478ad service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.417062 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-3ba90ede-6547-4369-8d2e-160aef89e7ab req-f05b95c0-d237-4185-84bb-90f83bf478ad service nova] Creating event network-changed:fe3999d6-abf8-455b-97de-e88dd06b7caa for instance b2a64ae5-5786-41de-9862-e321b902937a on hv-cinder-82660 Jun 23 11:58:59.423446 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-3ba90ede-6547-4369-8d2e-160aef89e7ab req-f05b95c0-d237-4185-84bb-90f83bf478ad service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033795 Jun 23 11:58:59.425272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 295/676] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:58:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:58:59.429534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:59.438930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0d10e885-1a21-4c31-9c2e-1346e1c9f1a7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1707 microversion: 2.1 time: 0.203626 Jun 23 11:58:59.449500 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 382/677] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:59 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1707 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:58:59.587391 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:59.588582 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:59.596346 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.597311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.598180 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.598815 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.643072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:59.643696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:59.676584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.677106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.677897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.678343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.908480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:59.921469 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a6208196-e552-49d0-95ad-3cd214a4389c tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1513 microversion: 2.1 time: 0.338473 Jun 23 11:58:59.928719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 296/678] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:59 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1513 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:58:59.928719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:58:59.928719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:58:59.949925 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.950386 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.951172 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:58:59.951609 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:58:59.955926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:59.968408 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:59.970598 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:58:59.972572 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-691c8b0e-8d4e-445b-8d66-08af6aa0850a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1751 microversion: 2.20 time: 0.340096 Jun 23 11:58:59.975437 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 383/679] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:58:59 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1751 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:00.000342 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:00.000825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:00.001462 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lazy-loading 'fault' on Instance uuid 567ad1bf-ef6b-41f9-800f-f589f136a1b6 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:59:00.052974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '74464ea11cbc4d44999583f93283a411', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd410564d1ba94f7883cd07fcf16be765', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:00.062152 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7782edc3-d58d-4c1f-a7d3-0837b1f987e3 tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 200 len: 1304 microversion: 2.1 time: 0.138142 Jun 23 11:59:00.062563 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 297/680] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:58:59 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 1304 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:00.459437 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:00.460228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:00.493198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:00.494654 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:00.496083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:00.496917 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:00.771719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:00.780591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-edacc648-ac0c-4f88-a45e-2e15f700c992 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1711 microversion: 2.1 time: 0.327792 Jun 23 11:59:00.781892 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 384/681] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:00 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1711 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:00.941973 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:00.942754 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:00.950341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:00.950874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:00.951891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:00.952438 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:00.995009 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:00.996153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:01.003218 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.003477 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.003857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.004327 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lazy-loading 'fault' on Instance uuid b53cbaa7-867e-41fd-ae9d-437ed7dab927 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:59:01.004894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.006462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.007270 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.083958 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'f7cf8ed5de4b41b19b6f25299087e1b5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a5a0086895b6442da90bc0f1bcecd3e7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:01.092529 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d2213079-9e47-4528-ab06-80c00f8d5536 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 200 len: 1309 microversion: 2.1 time: 0.156889 Jun 23 11:59:01.097145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 298/682] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:00 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 1309 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:01.109855 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:01.111922 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] [instance: 567ad1bf-ef6b-41f9-800f-f589f136a1b6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:01.123130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.123686 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.124907 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.125140 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.150367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] HTTP exception thrown: Instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 could not be found. Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Request method failure captured: Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 HTTP/1.1 Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFUyB_rS_n6FpOc6qda-rTTgVzX_0lbwtf9xu0TxFgrwe7ThzYHee4CodRFwPdcgjllNayGi_xkFMRbyAQeJ_WdEAbWh_acmUIavEjDM-tRA5JQFipE_CnwFkuwZ8hu2ct7ukqQfgi1xBEMarOHxWidFWtvhP1VFimg_FX3BP4I3N7M Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: d410564d1ba94f7883cd07fcf16be765 Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesNegativeTest-1623902244 Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:59:01.152168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d410564d1ba94f7883cd07fcf16be765"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d410564d1ba94f7883cd07fcf16be765"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d410564d1ba94f7883cd07fcf16be765"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d410564d1ba94f7883cd07fcf16be765"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesNegativeTest-1623902244 Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: d410564d1ba94f7883cd07fcf16be765 Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesNegativeTest-1623902244 Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesNegativeTest-1623902244-project Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 74464ea11cbc4d44999583f93283a411 Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesNegativeTest-1623902244-project Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 could not be found. Jun 23 11:59:01.153650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '567ad1bf-ef6b-41f9-800f-f589f136a1b6'} Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 could not be found. Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:59:01.154416 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 could not be found. Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 could not be found. Jun 23 11:59:01.155805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:01.156954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] Returning 404 to user: Instance 567ad1bf-ef6b-41f9-800f-f589f136a1b6 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:59:01.156954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fa031f13-5461-4485-8b4b-397020b0ce9d tempest-VolumesNegativeTest-1623902244 tempest-VolumesNegativeTest-1623902244-project] 10.222.0.67 "GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6" status: 404 len: 111 microversion: 2.1 time: 0.055786 Jun 23 11:59:01.156954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 299/683] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:01 2022] GET /compute/v2.1/servers/567ad1bf-ef6b-41f9-800f-f589f136a1b6 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:59:01.204012 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:01.205242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:01.215408 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.216345 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.217164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.217605 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.277155 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lazy-loading 'flavor' on Instance uuid 7a7bee95-4d0f-4a24-9abc-1d972470a137 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:59:01.391972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:01.404965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:01.406784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:01.407932 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bbbe7da5-69ab-467a-bb4a-613454137a2d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1751 microversion: 2.20 time: 0.418255 Jun 23 11:59:01.414683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 385/684] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:00 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1751 bytes in 424 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:01.427830 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e1dfec7f-c96f-42bb-8445-3659e12f698a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a1f445d9-7d77-4323-b913-c19a9d628f49"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:01.431733 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e1dfec7f-c96f-42bb-8445-3659e12f698a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:01.440648 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e1dfec7f-c96f-42bb-8445-3659e12f698a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.441187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e1dfec7f-c96f-42bb-8445-3659e12f698a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.441976 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e1dfec7f-c96f-42bb-8445-3659e12f698a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.442422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e1dfec7f-c96f-42bb-8445-3659e12f698a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.580863 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d1fae1c2-9d48-4915-b97a-a94c359a1c79 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/action" status: 200 len: 32 microversion: 2.1 time: 0.380692 Jun 23 11:59:01.584473 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 300/685] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:59:01 2022] POST /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/action => generated 32 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 11:59:01.595600 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-f2001545-8023-46a8-8e1b-c8fd212f96d7 req-9ffcba30-adad-44ff-8051-e7a9362e6967 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b53cbaa7-867e-41fd-ae9d-437ed7dab927", "name": "network-vif-deleted", "tag": "0b035da7-5c00-4cd0-8237-b2b2955053b7"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:01.622829 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f2001545-8023-46a8-8e1b-c8fd212f96d7 req-9ffcba30-adad-44ff-8051-e7a9362e6967 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.623281 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f2001545-8023-46a8-8e1b-c8fd212f96d7 req-9ffcba30-adad-44ff-8051-e7a9362e6967 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.637198 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-f2001545-8023-46a8-8e1b-c8fd212f96d7 req-9ffcba30-adad-44ff-8051-e7a9362e6967 service nova] Creating event network-vif-deleted:0b035da7-5c00-4cd0-8237-b2b2955053b7 for instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 on hv-cinder-82660 Jun 23 11:59:01.643394 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-f2001545-8023-46a8-8e1b-c8fd212f96d7 req-9ffcba30-adad-44ff-8051-e7a9362e6967 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.057241 Jun 23 11:59:01.644306 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 301/686] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:01.649523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:01.650424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:01.661284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.661284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.661284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:01.661284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:01.811156 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:01.819894 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-25bd9669-f2c2-4ee3-92ef-baac6178bb85 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.174250 Jun 23 11:59:01.820492 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 302/687] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:01 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:02.083342 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e1dfec7f-c96f-42bb-8445-3659e12f698a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.663990 Jun 23 11:59:02.085546 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 386/688] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:59:01 2022] POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments => generated 194 bytes in 670 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:02.111181 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:02.112435 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] [instance: b53cbaa7-867e-41fd-ae9d-437ed7dab927] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:02.124855 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:02.125303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:02.126314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:02.126977 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:02.149785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] HTTP exception thrown: Instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 could not be found. Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Request method failure captured: Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 HTTP/1.1 Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFS0QfscGNCst6m-gsWVXNzNXdN0JNoyrUXwuuHZ80Be7nApGrjhgUSxGPGWLpJNZoD_cF6rP2nE4Qqd_p3gAkoqEweBvioIkMRJcYwo-Il04-oeeILx7Wbxj9uNe1ZZGdn1WM1r-rZfuEs3RksFjtVXwOrc5qzRPfUZKirTaxvAKQ0 Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: a5a0086895b6442da90bc0f1bcecd3e7 Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesSnapshotTestJSON-81888496 Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:59:02.151787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a5a0086895b6442da90bc0f1bcecd3e7"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesSnapshotTestJSON-81888496 Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: a5a0086895b6442da90bc0f1bcecd3e7 Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-81888496 Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesSnapshotTestJSON-81888496-project Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: f7cf8ed5de4b41b19b6f25299087e1b5 Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesSnapshotTestJSON-81888496-project Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 could not be found. Jun 23 11:59:02.153363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'b53cbaa7-867e-41fd-ae9d-437ed7dab927'} Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 could not be found. Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:59:02.154088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 could not be found. Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 could not be found. Jun 23 11:59:02.155343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:02.158053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] Returning 404 to user: Instance b53cbaa7-867e-41fd-ae9d-437ed7dab927 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:59:02.159149 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-dd975487-e370-4e2f-b315-9b1eb52b9d94 tempest-VolumesSnapshotTestJSON-81888496 tempest-VolumesSnapshotTestJSON-81888496-project] 10.222.0.67 "GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927" status: 404 len: 111 microversion: 2.1 time: 0.052081 Jun 23 11:59:02.159944 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 303/689] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:02 2022] GET /compute/v2.1/servers/b53cbaa7-867e-41fd-ae9d-437ed7dab927 => generated 111 bytes in 53 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 11:59:02.427847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:02.428544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:02.436395 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:02.437148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:02.438097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:02.438685 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:02.706078 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:02.715924 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:02.717468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:02.718646 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e067243f-4a66-48da-901e-a97c8756d6a2 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.295608 Jun 23 11:59:02.721889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 387/690] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:02 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:02.836002 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:02.836903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:02.844097 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:02.845070 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:02.846040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:02.846861 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:03.239210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:03.254496 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bdc5da09-805e-45cf-b7cf-3da5f8ccc884 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.422172 Jun 23 11:59:03.256441 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 304/691] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:02 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:03.740480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:03.742024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:03.751465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:03.751990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:03.753058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:03.753620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:03.926738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:03.940062 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:03.941813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:03.943517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4760aedd-3d6f-43bd-883c-5188bda832fc tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.207872 Jun 23 11:59:03.944895 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 388/692] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:03 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:04.271362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:04.272380 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:04.292003 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:04.294252 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:04.301196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:04.302410 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:04.565275 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:04.582252 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5cac9121-9af5-42b0-974a-03ce67fa18e9 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.314587 Jun 23 11:59:04.591055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 305/693] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:04 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 323 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:04.965593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:04.966255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:04.983466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:04.984218 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:04.985196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:04.985792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:05.155401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:05.165098 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:05.167274 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:05.168607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-219eecb6-6560-4f64-9f25-26d07b601b2f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.208023 Jun 23 11:59:05.169219 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 389/694] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:04 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:05.605196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:05.606000 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:05.612947 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:05.613395 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:05.614163 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:05.614594 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:05.770653 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:05.779661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3f29e397-a5d6-494d-8515-308aca170622 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.181399 Jun 23 11:59:05.780267 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 306/695] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:05 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:06.197463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:06.198108 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:06.204989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:06.205558 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:06.206418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:06.207046 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:06.371436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:06.386808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:06.389421 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:06.391451 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2958e1fc-6f37-4a30-8bd0-b6742d3459b6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.198612 Jun 23 11:59:06.393159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 390/696] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:06 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:06.798128 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:06.799086 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:06.807938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:06.809048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:06.813597 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:06.814345 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:06.967066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:06.975552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-75371473-c723-46e1-a329-9491b6f0187a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.182127 Jun 23 11:59:06.976182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 307/697] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:06 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:07.412399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:07.413243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:07.422158 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:07.422615 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:07.423480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:07.423923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:07.575152 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:07.589124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:07.591527 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:07.592823 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0738c594-35e6-40fa-8924-e4956bb50239 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.185271 Jun 23 11:59:07.593389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 391/698] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:07 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:07.994533 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:07.995167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:08.001775 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:08.002221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:08.002990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:08.003417 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:08.161449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:08.172241 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fa162ef3-1c31-4849-9d3b-52d152313fe1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.181701 Jun 23 11:59:08.173167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 308/699] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:07 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:08.619988 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:08.620596 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:08.627207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:08.627661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:08.628435 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:08.628909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:08.807862 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:08.816412 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:08.817959 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:08.819125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-883a46ca-c83e-49d7-8927-34ad6d9c8255 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.203619 Jun 23 11:59:08.819688 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 392/700] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:08 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:09.191051 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:09.191627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:09.199546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:09.199983 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:09.200787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:09.201225 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:09.343014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:09.352834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b33204aa-0c6e-46fb-bcd7-0a50236e8227 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.166380 Jun 23 11:59:09.360723 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 309/701] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:09 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:09.837950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:09.838687 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:09.842029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:09.847478 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:09.847931 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:09.848900 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:09.849825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:09.997246 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:10.006092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:10.007802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:10.009779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-44cb2129-1202-444c-aca3-05724e718ae1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.175798 Jun 23 11:59:10.010343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 393/702] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:09 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:10.371364 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:10.372041 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:10.379099 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:10.379665 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:10.380511 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:10.380967 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:10.546177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:10.555243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0e0793e6-97be-483f-adf1-7d8e08fd23e0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.188287 Jun 23 11:59:10.556036 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 310/703] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:10 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:11.030231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:11.030981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:11.038088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:11.038625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:11.039490 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:11.039998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:11.187761 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:11.200031 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:11.202015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:11.203467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8a49fa3a-dc3b-4a6d-b733-cef7811c5abe tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.177547 Jun 23 11:59:11.206195 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 394/704] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:11 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:11.571672 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:11.573056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:11.580503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:11.581384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:11.582340 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:11.582785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:11.607961 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:11.745668 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:11.759873 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bfde8ab4-d289-4cbd-abfa-397df5e72c1a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.192178 Jun 23 11:59:11.760508 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 311/705] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:11 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:12.225430 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:12.227926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:12.261124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:12.261972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:12.263083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:12.263565 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:12.439063 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:12.453700 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:12.455628 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:12.457511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-052e7caf-9150-4218-af27-965746acf76f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.237806 Jun 23 11:59:12.458412 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 395/706] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:12 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:12.778439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:12.779840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:12.787568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:12.788403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:12.789451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:12.790647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:12.955925 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:12.966973 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6db0efbd-b96b-4d7d-9f38-9587b4926a98 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.193991 Jun 23 11:59:12.967840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 312/707] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:12 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:13.476311 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:13.476971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:13.484056 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:13.484511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:13.485530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:13.486031 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:13.615665 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:13.617927 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:13.626463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:13.627959 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:13.629149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-462bc284-f373-423f-b98f-a15200af8f01 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.157024 Jun 23 11:59:13.629701 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 396/708] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:13 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:13.983902 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:13.984514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:13.991039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:13.991491 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:13.992269 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:13.992736 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:14.124333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:14.132308 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e67f6c5e-afd9-4258-802b-df43277cc210 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.152270 Jun 23 11:59:14.132899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 313/709] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:13 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:14.647868 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:14.648432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:14.656373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:14.656839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:14.657623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:14.658048 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:14.791427 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:14.801270 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:14.802761 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:14.803942 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0c007c77-05a6-4577-8895-a95464bf1ca8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.160418 Jun 23 11:59:14.805647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 397/710] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:14 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:15.149702 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:15.150301 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:15.153379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:15.159315 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:15.159764 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:15.160535 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:15.160998 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:15.308068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:15.316260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-31a93dfb-9a8e-4659-8925-54b9c06570f8 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.170308 Jun 23 11:59:15.317045 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 314/711] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:15 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:15.823797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:15.824399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:15.830959 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:15.831405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:15.832163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:15.832591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:15.972967 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:15.982294 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:15.983824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:15.985050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-eec78551-db23-4445-80e0-03efcfd7d49e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.165153 Jun 23 11:59:15.985617 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 398/712] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:15 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 11:59:16.333406 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:16.334113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:16.341190 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:16.341636 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:16.342397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:16.342825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:16.502951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:16.516851 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-71f63507-bb04-4cb6-8ea9-74d0b47ff111 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.186618 Jun 23 11:59:16.517679 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 315/713] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:16 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:17.004109 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:17.004807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:17.011912 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:17.012359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:17.013149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:17.013578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:17.145520 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:17.156339 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:17.157898 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:17.159077 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8ae3f89d-a992-4ef9-90dd-78e64675a9cf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.159003 Jun 23 11:59:17.159639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 399/714] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:16 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:17.534995 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:17.535599 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:17.542684 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:17.543130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:17.543898 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:17.544309 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:17.675992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:17.684330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e013da2a-f2a5-486f-b3e7-df7417197c93 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.152999 Jun 23 11:59:17.684952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 316/715] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:17 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:18.177170 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:18.177814 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:18.184327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.184813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.185573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.186004 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.320515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:18.329484 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:18.330982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:18.332137 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-db526240-61ab-4580-bbfe-6f3edaf4d252 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.158888 Jun 23 11:59:18.332719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 400/716] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:18 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:18.701286 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:18.701904 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:18.708914 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.709362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.710132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:18.710569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:18.840209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:18.848159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-efd93d0b-6003-429f-9e33-f6f73bd2e376 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.150732 Jun 23 11:59:18.848749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 317/717] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:18 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:19.350308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:19.350939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:19.357571 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:19.358021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:19.358773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:19.359210 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:19.491106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:19.500177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:19.501700 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:19.502872 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-560b886a-7a2a-4807-b22d-e0e9871fbbf1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.156516 Jun 23 11:59:19.503690 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 401/718] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:19 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:19.864538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:19.865106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:19.871539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:19.872128 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:19.872771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:19.873207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:20.004163 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:20.012069 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-834ceb1e-4b95-4c00-bf30-f75f9f8bf901 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.151431 Jun 23 11:59:20.012641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 318/719] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:19 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:20.520134 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:20.520712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:20.527910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:20.528361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:20.529297 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:20.529744 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:20.661243 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:20.670573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:20.672359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:20.673560 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-de066116-1d3a-49a5-a6c7-eb9e8aebd437 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.157410 Jun 23 11:59:20.674107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 402/720] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:20 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:21.028921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:21.029585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:21.036568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:21.037052 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:21.037816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:21.038247 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:21.171558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:21.180461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-10676775-31d3-4486-894e-84dc048c1162 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.155408 Jun 23 11:59:21.181367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 319/721] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:21 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:21.691371 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:21.691976 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:21.698587 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:21.699035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:21.699792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:21.700221 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:21.831456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:21.839889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:21.841460 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:21.842622 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0211fe2c-fe88-46aa-933d-1c1043fad731 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.155202 Jun 23 11:59:21.843182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 403/722] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:21 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:22.197976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:22.198591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:22.205121 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:22.205571 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:22.206343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:22.206782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:22.335995 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:22.344752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f736a52b-9167-4277-bfa2-965d63672f5c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.150631 Jun 23 11:59:22.345357 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 320/723] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:22 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:22.860657 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:22.861295 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:22.867928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:22.868385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:22.869678 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:22.870117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:23.005012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:23.014069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:23.015578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:23.016760 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e25b99fc-1ef1-456c-b83a-7cd0064df479 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.160009 Jun 23 11:59:23.017320 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 404/724] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:22 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:23.362565 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:23.362949 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:23.370382 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:23.370843 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:23.371620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:23.372058 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:23.513065 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:23.521585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-61c337e4-e7b9-4f60-8bbe-bf8509423f33 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.162958 Jun 23 11:59:23.522153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 321/725] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:23 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:23.624263 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:23.625007 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:23.631611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:23.632062 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:23.632873 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:23.633369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:23.764778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:23.772618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bb46c9c9-e9e9-408a-8f2f-fe18547b6abe tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1592 microversion: 2.1 time: 0.152515 Jun 23 11:59:23.773203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 405/726] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:23 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1592 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:24.034857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:24.035771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:24.041841 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:24.042507 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:24.043498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:24.043933 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:24.514966 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:24.524303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:24.527127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:24.529220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-842e9512-dfb7-4b24-9ded-9d531d9aff8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.497861 Jun 23 11:59:24.529871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 322/727] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:24 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:24.545159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:24.545787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:24.548374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=82 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:24.553837 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:24.554289 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:24.555396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:24.556180 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:24.696356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:24.704487 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3eacba3b-6fd5-4b82-a4f1-ce8e3c056aca tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.163347 Jun 23 11:59:24.705110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 406/728] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:24 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:25.547617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:25.548288 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:25.555490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:25.556025 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:25.557218 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:25.557968 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:25.721717 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:25.722351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:25.729298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:25.729752 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:25.730565 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:25.731005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:25.784815 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:25.794467 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:25.796084 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:25.797920 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-892fe89e-51ef-4be3-a0e5-cd8d6c26950f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.254371 Jun 23 11:59:25.800759 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 323/729] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:25 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:25.877537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:25.887413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c997155a-eb94-427a-90b5-531c66bb3072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.169000 Jun 23 11:59:25.888140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 407/730] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:25 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:25.986906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-7e321f4b-152f-4b2b-82d4-6b0ae206b1ff req-4f22c874-20bf-4e0f-8758-bd2bbc7132e8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dde8e4-1b68-42be-ab9d-7a47869a6214", "tag": "1bf26417-9e61-446b-af12-0f2d3c6c3a6c"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:25.997937 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-7e321f4b-152f-4b2b-82d4-6b0ae206b1ff req-4f22c874-20bf-4e0f-8758-bd2bbc7132e8 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:25.998631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-7e321f4b-152f-4b2b-82d4-6b0ae206b1ff req-4f22c874-20bf-4e0f-8758-bd2bbc7132e8 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:26.015437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-7e321f4b-152f-4b2b-82d4-6b0ae206b1ff req-4f22c874-20bf-4e0f-8758-bd2bbc7132e8 service nova] Creating event network-changed:1bf26417-9e61-446b-af12-0f2d3c6c3a6c for instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 on hv-cinder-82660 Jun 23 11:59:26.022239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-7e321f4b-152f-4b2b-82d4-6b0ae206b1ff req-4f22c874-20bf-4e0f-8758-bd2bbc7132e8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039660 Jun 23 11:59:26.023681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 324/731] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:26.819117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:26.820819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:26.833619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:26.834979 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:26.837360 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:26.838087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:26.909066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:26.909690 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:26.929161 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:26.929734 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:26.930590 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:26.931025 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:27.118028 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:27.131702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:27.133691 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:27.134992 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a7c107fe-3f8c-40a6-822f-12cc039a6547 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.320940 Jun 23 11:59:27.138147 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 408/732] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:26 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 325 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:27.143004 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1649003667"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:27.143529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:27.155373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:27.156204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:27.157015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:27.157628 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:27.167212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:27.177933 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c568ec64-0da7-4fb4-9492-c4563ada83ba tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.275901 Jun 23 11:59:27.185625 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 325/733] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:26 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:27.329756 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.network.security_group_api [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Adding security group 82610bff-26de-4555-9dc7-20803ba54066 to port 1bf26417-9e61-446b-af12-0f2d3c6c3a6c Jun 23 11:59:27.966580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-76e6d8f1-141a-492c-abfe-6acc6aa978a5 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/action" status: 202 len: 0 microversion: 2.1 time: 0.827171 Jun 23 11:59:27.971003 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 409/734] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:59:27 2022] POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/action => generated 0 bytes in 832 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:59:27.975421 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:27.976038 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:27.984816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:27.985442 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:27.986404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:27.987014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:27.987415 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-a0d6f7d0-0d74-4b3f-9b3b-a559a80e133d req-d0f3ef04-bfb3-4fef-9616-8d34efa8c8e7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dde8e4-1b68-42be-ab9d-7a47869a6214", "tag": "1bf26417-9e61-446b-af12-0f2d3c6c3a6c"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:27.999488 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-a0d6f7d0-0d74-4b3f-9b3b-a559a80e133d req-d0f3ef04-bfb3-4fef-9616-8d34efa8c8e7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:28.000250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-a0d6f7d0-0d74-4b3f-9b3b-a559a80e133d req-d0f3ef04-bfb3-4fef-9616-8d34efa8c8e7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:28.018035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-a0d6f7d0-0d74-4b3f-9b3b-a559a80e133d req-d0f3ef04-bfb3-4fef-9616-8d34efa8c8e7 service nova] Creating event network-changed:1bf26417-9e61-446b-af12-0f2d3c6c3a6c for instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 on hv-cinder-82660 Jun 23 11:59:28.026611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-a0d6f7d0-0d74-4b3f-9b3b-a559a80e133d req-d0f3ef04-bfb3-4fef-9616-8d34efa8c8e7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046764 Jun 23 11:59:28.031835 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 410/735] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 11:59:28.155237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:28.155957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:28.163972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:28.164428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:28.165443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:28.166668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:28.280068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:28.289982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-998bdd61-3b47-4329-abc5-eb036a6a8612 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1639 microversion: 2.1 time: 0.318292 Jun 23 11:59:28.290935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 326/736] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:27 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1639 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:28.318602 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:28.319696 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:28.328101 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:28.329008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:28.330882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:28.332147 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:28.367107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:28.376193 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:28.377748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:28.378941 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2a8f823a-72bb-47aa-8240-edb6a5049dd3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.228794 Jun 23 11:59:28.390050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 411/737] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:28 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:28.473762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:28.481874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5fc7fd7f-eb53-4d97-89de-75e9c2d3eb75 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.169998 Jun 23 11:59:28.482534 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 327/738] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:28 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:28.881937 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-999762c0-02a8-4a43-9940-81a74144dfdc req-af7e4410-cafa-4e45-9ab2-22af18c4d255 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ec4d3-4ce1-4fbd-81ea-025a5c724421", "name": "network-vif-plugged", "status": "completed", "tag": "8e9b4dc6-7a9c-4183-b1a8-10297c792e0e"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:28.893349 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-999762c0-02a8-4a43-9940-81a74144dfdc req-af7e4410-cafa-4e45-9ab2-22af18c4d255 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:28.893791 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-999762c0-02a8-4a43-9940-81a74144dfdc req-af7e4410-cafa-4e45-9ab2-22af18c4d255 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:28.906373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-999762c0-02a8-4a43-9940-81a74144dfdc req-af7e4410-cafa-4e45-9ab2-22af18c4d255 service nova] Creating event network-vif-plugged:8e9b4dc6-7a9c-4183-b1a8-10297c792e0e for instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 on hv-cinder-82660 Jun 23 11:59:28.912370 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-999762c0-02a8-4a43-9940-81a74144dfdc req-af7e4410-cafa-4e45-9ab2-22af18c4d255 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034268 Jun 23 11:59:28.913017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 412/739] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:29.397426 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:29.397941 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:29.405069 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:29.405529 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:29.406338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:29.407434 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:29.499742 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:29.500528 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:29.506863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:29.507311 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:29.508071 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:29.508507 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:29.541424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:29.545225 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:29.552195 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:29.554315 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:29.555504 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-17d8f75d-f48f-4943-902d-b0e71cfe7916 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.162085 Jun 23 11:59:29.566575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 328/740] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:29 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:29.659151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:29.667338 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d540b80a-a27d-4eae-a89a-ba33630dda8d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1734 microversion: 2.1 time: 0.172203 Jun 23 11:59:29.667944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 413/741] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:29 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1734 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:30.574196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:30.574722 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:30.581175 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:30.581632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:30.582398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:30.582835 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:30.684903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:30.685524 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:30.692641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:30.693142 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:30.693924 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:30.694363 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:30.806750 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:30.816193 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:30.817771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:30.818979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-eb6d8d57-b55f-4826-859d-adbdd17b3148 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.249132 Jun 23 11:59:30.819584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 329/742] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:30 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:30.835520 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:30.844336 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c450bc76-fd24-4f46-aee4-fe2db784e165 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1714 microversion: 2.1 time: 0.163534 Jun 23 11:59:30.844965 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 414/743] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:30 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1714 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:30.954080 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:30.954609 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:30.960618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:30.961101 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:30.961874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:30.962312 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:31.047034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] HTTP exception thrown: Cannot 'detach_volume' instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 while it is in vm_state rescued Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Request method failure captured: Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments/8ecaf2b7-aeee-4a22-828c-f793fd65175b HTTP/1.1 Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSKAAp6qrKeaawTlKefza8FWjHIgItwm35jOuhUXipytjbbMDMJWgWnmVArHcbPZtNrKA4QL87Xmh6HJ89-FiqVjANRs4es7oVQEf9mhxpXOQVOOcMEpy2R0T0Uos278lOZ963Zn_zVlv68QVt1ZGwtNRgH6-xVoOO6N3NX_1DBySM Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 11:59:31.048814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 53f1188f2446493baae7dc79bbb66ff7 Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 11:59:31.050430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Cannot 'detach_volume' instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 while it is in vm_state rescued Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'server_id': '7a7bee95-4d0f-4a24-9abc-1d972470a137', 'id': '8ecaf2b7-aeee-4a22-828c-f793fd65175b'} Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:59:31.051250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 while it is in vm_state rescued Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 while it is in vm_state rescued Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 11:59:31.052847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Returning 409 to user: Cannot 'detach_volume' instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 while it is in vm_state rescued {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:59:31.054564 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-238332f7-5c59-4a5f-a4bf-14a41b857e73 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments/8ecaf2b7-aeee-4a22-828c-f793fd65175b" status: 409 len: 152 microversion: 2.1 time: 0.100213 Jun 23 11:59:31.054564 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 330/744] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 11:59:30 2022] DELETE /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments/8ecaf2b7-aeee-4a22-828c-f793fd65175b => generated 152 bytes in 102 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 23 11:59:31.059712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f2412123-9f70-4e99-8256-ad89b755cc2d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:31.060242 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f2412123-9f70-4e99-8256-ad89b755cc2d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:31.067549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2412123-9f70-4e99-8256-ad89b755cc2d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:31.068004 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2412123-9f70-4e99-8256-ad89b755cc2d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:31.068836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2412123-9f70-4e99-8256-ad89b755cc2d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:31.069273 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f2412123-9f70-4e99-8256-ad89b755cc2d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:31.073655 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:31.143298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f2412123-9f70-4e99-8256-ad89b755cc2d tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "POST /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/action" status: 202 len: 0 microversion: 2.1 time: 0.087272 Jun 23 11:59:31.144699 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 415/745] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:59:31 2022] POST /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/action => generated 0 bytes in 89 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:59:31.154279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:31.155107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:31.165410 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:31.166181 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:31.166977 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:31.167442 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:31.305721 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:31.313791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-82c7e98d-4691-46e5-a11e-03a71087dcad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1722 microversion: 2.1 time: 0.165707 Jun 23 11:59:31.314355 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 331/746] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:31 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1722 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:31.838088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:31.839477 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:31.846483 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:31.846927 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:31.847691 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:31.848114 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:31.990714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:31.999809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:32.001378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:32.002546 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7fa336e8-697a-496d-9f7e-ca908d341e93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1807 microversion: 2.20 time: 0.168788 Jun 23 11:59:32.003106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 416/747] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:31 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1807 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:32.333315 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:32.334541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:32.346647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:32.347783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:32.349804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:32.350415 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:32.547085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:32.555678 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e5f8ec77-4a90-4481-ac87-6032f9c6f4ad tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1722 microversion: 2.1 time: 0.227318 Jun 23 11:59:32.556258 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 332/748] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:32 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1722 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:33.021535 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:33.022055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:33.029318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:33.029739 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:33.030515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:33.030985 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:33.162419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:33.172597 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:33.175033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:33.176661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a77a4f53-7192-42e6-8b01-f160cd40db8e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1794 microversion: 2.20 time: 0.159131 Jun 23 11:59:33.177260 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 417/749] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 11:59:33 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1794 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 11:59:33.573319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:33.573932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:33.580398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:33.580962 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:33.581727 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:33.582333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:33.719379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:33.727477 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-735737c3-9296-474c-975c-ad96dd512083 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1722 microversion: 2.1 time: 0.157934 Jun 23 11:59:33.728052 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 333/750] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:33 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:34.743244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:34.744054 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:34.751103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:34.751618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:34.752409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:34.752880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:34.891983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:34.900248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6a062290-c034-4298-9022-23bb698548d0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1722 microversion: 2.1 time: 0.160781 Jun 23 11:59:34.900859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 418/751] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:34 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1722 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:35.918426 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:35.919183 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:35.926650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:35.927531 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:35.928721 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:35.929401 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:36.456095 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:36.465027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-38f02814-f187-4f1a-8a1c-6b57c95c22db tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1728 microversion: 2.1 time: 0.551476 Jun 23 11:59:36.465744 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 334/752] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:35 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1728 bytes in 553 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:36.481688 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6602ccf6-e237-4347-91d5-20d023a69e9c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:36.482195 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6602ccf6-e237-4347-91d5-20d023a69e9c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:36.493812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6602ccf6-e237-4347-91d5-20d023a69e9c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:36.494623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6602ccf6-e237-4347-91d5-20d023a69e9c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:36.496406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6602ccf6-e237-4347-91d5-20d023a69e9c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:36.497230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6602ccf6-e237-4347-91d5-20d023a69e9c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:36.606077 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6602ccf6-e237-4347-91d5-20d023a69e9c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.128454 Jun 23 11:59:36.612605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 419/753] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 11:59:36 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:37.962105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-3ee0577d-845e-4e4d-aa1d-69ffd4ebe80e req-13f37ab1-9135-4698-8edd-b0739905b243 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7bee95-4d0f-4a24-9abc-1d972470a137", "tag": "e482920e-48e2-4b63-930d-1d004fbb0de0"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:37.983807 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-3ee0577d-845e-4e4d-aa1d-69ffd4ebe80e req-13f37ab1-9135-4698-8edd-b0739905b243 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:37.984230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-3ee0577d-845e-4e4d-aa1d-69ffd4ebe80e req-13f37ab1-9135-4698-8edd-b0739905b243 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:38.000664 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-3ee0577d-845e-4e4d-aa1d-69ffd4ebe80e req-13f37ab1-9135-4698-8edd-b0739905b243 service nova] Creating event network-changed:e482920e-48e2-4b63-930d-1d004fbb0de0 for instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 on hv-cinder-82660 Jun 23 11:59:38.006366 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-3ee0577d-845e-4e4d-aa1d-69ffd4ebe80e req-13f37ab1-9135-4698-8edd-b0739905b243 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047750 Jun 23 11:59:38.007808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 335/754] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:40.022183 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-91daa544-3dbf-4f8f-bc9c-9caa490780c6 req-dd83bdde-2b5e-4926-a817-909e2ed64499 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7a7bee95-4d0f-4a24-9abc-1d972470a137", "tag": "e482920e-48e2-4b63-930d-1d004fbb0de0"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:40.031737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-91daa544-3dbf-4f8f-bc9c-9caa490780c6 req-dd83bdde-2b5e-4926-a817-909e2ed64499 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:40.032404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-91daa544-3dbf-4f8f-bc9c-9caa490780c6 req-dd83bdde-2b5e-4926-a817-909e2ed64499 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:40.044950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-91daa544-3dbf-4f8f-bc9c-9caa490780c6 req-dd83bdde-2b5e-4926-a817-909e2ed64499 service nova] Creating event network-changed:e482920e-48e2-4b63-930d-1d004fbb0de0 for instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 on hv-cinder-82660 Jun 23 11:59:40.050778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-91daa544-3dbf-4f8f-bc9c-9caa490780c6 req-dd83bdde-2b5e-4926-a817-909e2ed64499 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032068 Jun 23 11:59:40.051604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 420/755] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:40 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:45.302649 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2e5616fb-e8ce-4043-97b6-64637a653b59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Action: 'create', calling method: .version_select at 0x7f3aea82af70>, body: {"keypair": {"name": "tempest-TestShelveInstance-1291048427", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHhbeojyg06lgRcKUiGnejUU8pLq30jzjJ+xHTyXIlqRGjzY88+/1mQDgTI+gSsiGohuGhU7jkDWOCAb4T5HVnkfOTPoWdqjiWzlvUf9HGhXIm/5PFJjMJZt7KAHZo0Xxw=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:45.306712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=44 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:45.321869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-2e5616fb-e8ce-4043-97b6-64637a653b59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Getting quotas for project a2d3e44f4113405a9cd4e604aea9955b. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 11:59:45.326490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-2e5616fb-e8ce-4043-97b6-64637a653b59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Getting quotas for user 62766b6eeb3d47beb5e3d056fb6d5d81 and project a2d3e44f4113405a9cd4e604aea9955b. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 11:59:45.349914 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2e5616fb-e8ce-4043-97b6-64637a653b59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 397 microversion: 2.1 time: 0.224010 Jun 23 11:59:45.350511 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 336/756] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 11:59:45 2022] POST /compute/v2.1/os-keypairs => generated 397 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:51.139065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=29 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:51.139842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=33,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:51.144154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3a3f2c4c-2791-4920-bc96-a5301f55346a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:51.145298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3a3f2c4c-2791-4920-bc96-a5301f55346a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:51.153887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3f2c4c-2791-4920-bc96-a5301f55346a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:51.154337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3f2c4c-2791-4920-bc96-a5301f55346a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:51.155155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3f2c4c-2791-4920-bc96-a5301f55346a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:51.155558 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a3f2c4c-2791-4920-bc96-a5301f55346a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:51.229185 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3a3f2c4c-2791-4920-bc96-a5301f55346a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/action" status: 202 len: 0 microversion: 2.1 time: 0.091471 Jun 23 11:59:51.233502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 421/757] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:59:51 2022] POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:59:51.237014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=38 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:51.245136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:51.246459 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:51.262354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:51.263401 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:51.266245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:51.267373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:51.634745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:51.643343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cfbabb7e-bece-4a29-94f4-443437bbc909 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1749 microversion: 2.1 time: 0.408463 Jun 23 11:59:51.644138 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 337/758] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:51 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1749 bytes in 410 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:52.241296 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:52.241883 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:52.249295 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:52.249748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:52.250531 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:52.250969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:52.624163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lazy-loading 'services' on Instance uuid 7134bd36-8b37-48ff-bcfb-ab369c0ef601 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:59:52.661245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:52.662460 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:52.670166 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:52.670166 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:52.670856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:52.671292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:52.744012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-982e7382-b42b-42df-afe0-a3d2aa086b8c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-volume_attachments/62d3bae1-437a-42c9-bf80-0d0d0aeac4b8" status: 202 len: 0 microversion: 2.1 time: 0.506790 Jun 23 11:59:52.745083 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 422/759] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 11:59:52 2022] DELETE /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-volume_attachments/62d3bae1-437a-42c9-bf80-0d0d0aeac4b8 => generated 0 bytes in 509 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:59:52.847758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:52.856544 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a4d6467b-74b9-4189-a9a4-ead08dbe1240 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.199089 Jun 23 11:59:52.857155 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 338/760] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:52 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:53.866792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ffc79215-771c-4536-a19c-5531b58514cd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:53.874590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ffc79215-771c-4536-a19c-5531b58514cd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:53.875053 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ffc79215-771c-4536-a19c-5531b58514cd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:53.875726 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:53.876586 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:53.884025 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:53.884475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:53.885310 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:53.885746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:53.898424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ffc79215-771c-4536-a19c-5531b58514cd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Going to try to stop instance {{(pid=117746) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 23 11:59:53.953802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ffc79215-771c-4536-a19c-5531b58514cd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action" status: 202 len: 0 microversion: 2.1 time: 0.091455 Jun 23 11:59:53.955370 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 423/761] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 11:59:53 2022] POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:59:53.963125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:53.964093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:53.971514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:53.972336 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:53.973189 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:53.973633 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:54.052979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:54.061619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-835f7d6f-1ed5-45db-b7b7-c42361238a6e tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.191349 Jun 23 11:59:54.062719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 339/762] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:53 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:54.115117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:54.123779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e57a9887-fc0a-4665-acc0-8c2344f81511 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.165039 Jun 23 11:59:54.124551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 424/763] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:53 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:54.894430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aff4a5cd-55d2-4923-b250-eb6234b8f367 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:54.894985 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-aff4a5cd-55d2-4923-b250-eb6234b8f367 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:54.903066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aff4a5cd-55d2-4923-b250-eb6234b8f367 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:54.903519 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aff4a5cd-55d2-4923-b250-eb6234b8f367 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:54.904287 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aff4a5cd-55d2-4923-b250-eb6234b8f367 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:54.904747 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aff4a5cd-55d2-4923-b250-eb6234b8f367 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:54.928485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-aff4a5cd-55d2-4923-b250-eb6234b8f367 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a/ips" status: 200 len: 150 microversion: 2.1 time: 0.037828 Jun 23 11:59:54.928999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 340/764] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 11:59:54 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a/ips => generated 150 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:54.939336 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e59c50bb-57a9-43e8-ad0d-2176411fe943"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:54.940459 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:54.947144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:54.947595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:54.948378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:54.948900 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.030370 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Invalid volume: volume e59c50bb-57a9-43e8-ad0d-2176411fe943 is already attached to instances: d67c82c1-7c40-43a6-9326-480dc5fcb37a Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: POST /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a/os-volume_attachments HTTP/1.1 Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 74 Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 11:59:55.032470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {"volumeAttachment": {"volumeId": "e59c50bb-57a9-43e8-ad0d-2176411fe943"}} Jun 23 11:59:55.034087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Invalid volume: volume e59c50bb-57a9-43e8-ad0d-2176411fe943 is already attached to instances: d67c82c1-7c40-43a6-9326-480dc5fcb37a Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'server_id': 'b2a64ae5-5786-41de-9862-e321b902937a', 'body': {'volumeAttachment': {'volumeId': 'e59c50bb-57a9-43e8-ad0d-2176411fe943'}}} Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume e59c50bb-57a9-43e8-ad0d-2176411fe943 is already attached to instances: d67c82c1-7c40-43a6-9326-480dc5fcb37a Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:55.035174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume e59c50bb-57a9-43e8-ad0d-2176411fe943 is already attached to instances: d67c82c1-7c40-43a6-9326-480dc5fcb37a Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:55.036599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume e59c50bb-57a9-43e8-ad0d-2176411fe943 is already attached to instances: d67c82c1-7c40-43a6-9326-480dc5fcb37a Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 400 to user: Invalid volume: volume e59c50bb-57a9-43e8-ad0d-2176411fe943 is already attached to instances: d67c82c1-7c40-43a6-9326-480dc5fcb37a {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-27deb57f-f647-4e53-8362-1bcb077c591f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.098608 Jun 23 11:59:55.038155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 425/765] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 11:59:54 2022] POST /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a/os-volume_attachments => generated 174 bytes in 100 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 11:59:55.045059 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:55.045598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:55.052014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.052467 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.053332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.053772 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.079280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 11:59:55.079558 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:55.080231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:55.088162 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.088618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.089420 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.089855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.165182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f656bb8b-c59d-4903-916d-499c05f1a754 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 204 len: 0 microversion: 2.1 time: 0.125513 Jun 23 11:59:55.169836 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 341/766] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 11:59:55 2022] DELETE /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 11:59:55.172310 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:55.173226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:55.179693 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.180101 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.180911 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.181353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.256514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:55.265384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-88e83cec-12d7-4807-9fda-120a568a3790 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.189902 Jun 23 11:59:55.265954 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 426/767] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:55 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:55.271709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:55.272313 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:55.278543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.279204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.280120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:55.280737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:55.333962 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=4 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 11:59:55.339784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:55.349060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d46d4a72-82e8-4bf8-8fce-ec7ff7c6fbbb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.181702 Jun 23 11:59:55.349932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 342/768] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:55 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:55.435296 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:55.443109 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f31deb1c-2efb-48c6-bf9c-37eb47469c60 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1682 microversion: 2.1 time: 0.175677 Jun 23 11:59:55.444033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 427/769] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:55 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1682 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:56.282982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:56.283371 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:56.289737 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:56.290180 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:56.290947 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:56.291377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:56.367065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:56.367702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:56.374803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:56.375244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:56.376127 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:56.376645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:56.450003 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:56.458184 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9ac093b0-26cb-4e75-90f4-ee22bab08bd4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.179457 Jun 23 11:59:56.458751 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 343/770] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:56 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:56.463319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:56.463984 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:56.472928 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:56.473414 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:56.474198 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:56.474635 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:56.512570 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:56.520287 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-76c314fb-937e-42c2-ae5c-d6d09d86aa9d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.157035 Jun 23 11:59:56.520917 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 428/771] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:56 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:56.616445 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:56.624167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1637cc10-efb3-4cbc-8273-3a74cfab0b7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1682 microversion: 2.1 time: 0.164465 Jun 23 11:59:56.624761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 344/772] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:56 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1682 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:57.475389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:57.476161 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:57.487211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:57.488169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:57.489474 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:57.489928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:57.546791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:57.548253 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:57.554852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:57.555299 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:57.556265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:57.556715 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:57.671774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:57.680624 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5eb3ddfc-1163-4101-9ec9-2ec9f92566fd tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.209230 Jun 23 11:59:57.681316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 429/773] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:57 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:57.686556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:57.687156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:57.693204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:57.693635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:57.694397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:57.694821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:57.765533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:57.773496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ec6df63f-7f95-42d4-8d43-544dc15e3018 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 200 len: 1614 microversion: 2.1 time: 0.091211 Jun 23 11:59:57.774065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 430/774] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:57 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 1614 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:57.807022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:57.815477 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-64421f22-d099-4caf-9c3c-cf9aaedf80f1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.273158 Jun 23 11:59:57.816255 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 345/775] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:57 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 11:59:57.978026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-4037c12a-ee9b-4f21-a521-5b56a70147a1 req-1b630b2d-aa22-492e-b5b1-80e4ad94e2c9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b2a64ae5-5786-41de-9862-e321b902937a", "name": "network-vif-deleted", "tag": "fe3999d6-abf8-455b-97de-e88dd06b7caa"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 11:59:57.994912 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-4037c12a-ee9b-4f21-a521-5b56a70147a1 req-1b630b2d-aa22-492e-b5b1-80e4ad94e2c9 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:57.995482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-4037c12a-ee9b-4f21-a521-5b56a70147a1 req-1b630b2d-aa22-492e-b5b1-80e4ad94e2c9 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:58.009970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-4037c12a-ee9b-4f21-a521-5b56a70147a1 req-1b630b2d-aa22-492e-b5b1-80e4ad94e2c9 service nova] Creating event network-vif-deleted:fe3999d6-abf8-455b-97de-e88dd06b7caa for instance b2a64ae5-5786-41de-9862-e321b902937a on hv-cinder-82660 Jun 23 11:59:58.017094 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-4037c12a-ee9b-4f21-a521-5b56a70147a1 req-1b630b2d-aa22-492e-b5b1-80e4ad94e2c9 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042566 Jun 23 11:59:58.021318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 431/776] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 11:59:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:58.698087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:58.698819 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:58.706755 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:58.707354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:58.708243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:58.708928 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:58.790920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:58.791616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:58.801142 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:58.801800 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:58.802767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:58.803358 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:58.819256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a HTTP/1.1 Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 11:59:58.821039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 11:59:58.822373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'b2a64ae5-5786-41de-9862-e321b902937a'} Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 11:59:58.823139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 11:59:58.824378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 11:59:58.826145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 11:59:58.826145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fea950d6-e96b-4d13-83e2-c7dcd7d2a2bf tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 404 len: 111 microversion: 2.1 time: 0.035737 Jun 23 11:59:58.826481 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 432/777] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:58 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 11:59:58.836810 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-56c9b9f1-4692-475d-9bbb-aa28204206b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '.version_select at 0x7f3ae60043a0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:58.859064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-56c9b9f1-4692-475d-9bbb-aa28204206b0 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-707672602" status: 202 len: 0 microversion: 2.1 time: 0.026065 Jun 23 11:59:58.860049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 433/778] 10.222.0.67 () {58 vars in 1217 bytes} [Thu Jun 23 11:59:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-707672602 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:59:58.864859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:58.865468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:58.874033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:58.880069 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:58.880369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:58.881257 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:58.881866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:58.895849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cf18d7ad-be4f-42a8-b8f2-54eb57a4480c tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.202092 Jun 23 11:59:58.896599 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 346/779] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:58 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:59.080572 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 11:59:59.089413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3f5f75c7-ee8e-44c6-9fa2-621460a0c3f3 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.228172 Jun 23 11:59:59.090126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 434/780] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:58 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 11:59:59.662689 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:59.663546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:59.670977 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:59.671490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:59.672323 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:59.673122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:59.761240 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lazy-loading 'services' on Instance uuid d67c82c1-7c40-43a6-9326-480dc5fcb37a {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 11:59:59.839718 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-85e813f3-5d73-48a5-b466-9e6a56d6a8b1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments/e59c50bb-57a9-43e8-ad0d-2176411fe943" status: 202 len: 0 microversion: 2.1 time: 0.180721 Jun 23 11:59:59.841067 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 347/781] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 11:59:59 2022] DELETE /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments/e59c50bb-57a9-43e8-ad0d-2176411fe943 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 11:59:59.849557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ccb9e845-0383-4566-be15-73abb56b4091 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:59.851291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ccb9e845-0383-4566-be15-73abb56b4091 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:59.859034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ccb9e845-0383-4566-be15-73abb56b4091 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:59.859515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ccb9e845-0383-4566-be15-73abb56b4091 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:59.860305 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ccb9e845-0383-4566-be15-73abb56b4091 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:59.860786 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ccb9e845-0383-4566-be15-73abb56b4091 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:59.894407 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ccb9e845-0383-4566-be15-73abb56b4091 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049011 Jun 23 11:59:59.895466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 435/782] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 11:59:59 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 11:59:59.913599 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 11:59:59.914292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 11:59:59.920824 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:59.921356 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 11:59:59.922095 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 11:59:59.922528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:00.071436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:00.080105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cf4d9685-c9a6-4c5c-9c5a-cca1df17ea53 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.170646 Jun 23 12:00:00.080777 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 348/783] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 11:59:59 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:00.216519 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:00.217180 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:00.223379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:00.223833 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:00.224606 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:00.225106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:00.358152 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:00.365907 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-06b0dfdf-ac14-4f9e-b652-52b20794bc8b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.262547 Jun 23 12:00:00.366480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 436/784] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:00 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:00.907021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-18519684-5bfa-40eb-9fae-8408d82d54e7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:00.907936 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-18519684-5bfa-40eb-9fae-8408d82d54e7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:00.913951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18519684-5bfa-40eb-9fae-8408d82d54e7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:00.914404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18519684-5bfa-40eb-9fae-8408d82d54e7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:00.915171 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18519684-5bfa-40eb-9fae-8408d82d54e7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:00.915614 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18519684-5bfa-40eb-9fae-8408d82d54e7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:00.945809 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-18519684-5bfa-40eb-9fae-8408d82d54e7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042989 Jun 23 12:00:00.946364 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 349/785] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:00:00 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 12:00:01.097485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:01.098223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:01.104379 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.104873 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.105116 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:01.105619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:01.105739 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.106065 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.112199 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.112663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.113447 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.113882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.118264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:01.141550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:00:01.225926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-897e0fdf-dbf6-4aa4-b98c-abde05010da5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 204 len: 0 microversion: 2.1 time: 0.224946 Jun 23 12:00:01.226913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 437/786] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:00:00 2022] DELETE /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 0 bytes in 227 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:00:01.236303 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:01.237049 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:01.243392 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.243837 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.244614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.245074 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.292456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:01.301847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-da99bd9a-83cf-477d-9f1a-3038b8f7ea03 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.208086 Jun 23 12:00:01.302649 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 350/787] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:01 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:01.383832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:01.384440 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:01.385524 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:01.391167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.391701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.392370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:01.392833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:01.393784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1e87574b-b910-48e5-9275-6092a68ccc7c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1681 microversion: 2.1 time: 0.162479 Jun 23 12:00:01.394362 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 438/788] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:01 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:01.411732 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:01.528099 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:01.536221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6b39f016-6a24-4c16-b08a-a06cbdd61a8a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.156753 Jun 23 12:00:01.536801 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 351/789] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:01 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:02.320512 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:02.321157 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:02.327837 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:02.328337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:02.329124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:02.329564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:02.410585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:02.411333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:02.418230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:02.418678 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:02.419553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:02.420700 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:02.478404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:02.487930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c92dcb21-d521-4c70-b8ed-584fc8f22bb4 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.172850 Jun 23 12:00:02.488562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 439/790] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:02 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:02.550853 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1439718224", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-1291048427", "security_groups": [{"name": "tempest-secgroup-smoke-1052117603"}], "networks": [{"uuid": "a13aae4c-de05-481c-b4e4-5c7570ff46f8"}], "block_device_mapping_v2": [{"uuid": "f9c4efab-2e89-4e54-a6ec-2b14e7049039", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:02.560662 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:02.569790 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7dd7140c-81f1-4be3-945f-4a2e2db168bd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1681 microversion: 2.1 time: 0.162865 Jun 23 12:00:02.570536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 352/791] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:02 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1681 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:02.584083 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:02.584738 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:02.592203 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:02.592656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:02.593516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:02.593952 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:02.665477 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] validate_networks() for [('a13aae4c-de05-481c-b4e4-5c7570ff46f8', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:00:02.727786 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:02.735942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bf0b7d46-fd8a-4bcb-b0d2-56e391ac413f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.155495 Jun 23 12:00:02.736513 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 353/792] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:02 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:03.084070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:00:03.084505 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:00:03.085038 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:00:03.085458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:00:03.085874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:00:03.096117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.096501 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.097337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.097776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.114677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Getting quotas for project a2d3e44f4113405a9cd4e604aea9955b. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:00:03.118683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Getting quotas for user 62766b6eeb3d47beb5e3d056fb6d5d81 and project a2d3e44f4113405a9cd4e604aea9955b. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:00:03.177855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:00:03.179925 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='f9c4efab-2e89-4e54-a6ec-2b14e7049039',volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:00:03.311945 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-26e06143-e656-4486-b457-5587b6e77237 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 0.765310 Jun 23 12:00:03.318296 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 440/793] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 12:00:02 2022] POST /compute/v2.1/servers => generated 406 bytes in 767 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 23 12:00:03.324106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-381c47ca-9b49-497d-971f-f9234a507588 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:03.325007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-381c47ca-9b49-497d-971f-f9234a507588 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:03.456500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-381c47ca-9b49-497d-971f-f9234a507588 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:03.464849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-381c47ca-9b49-497d-971f-f9234a507588 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1089 microversion: 2.1 time: 0.145414 Jun 23 12:00:03.466347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 354/794] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:03 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1089 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:03.507278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:03.508201 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:03.516079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.516988 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.517689 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.518130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.587157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:03.588274 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:03.596423 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.597258 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.598532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.598986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.718292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:03.726223 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-53f1a324-1ff4-4bc2-b4be-44e289db2c70 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.224774 Jun 23 12:00:03.726821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 441/795] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:03 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:03.753766 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:03.754392 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:03.761287 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.761745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.762535 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:03.762981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:03.914708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:03.923738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-72776c5f-1b87-450f-a606-4715207df5db tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.174170 Jun 23 12:00:03.924327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 442/796] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:03 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:04.195448 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:04.204112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-10705ea1-f1a4-4b91-b098-0970bfa72630 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1681 microversion: 2.1 time: 0.620879 Jun 23 12:00:04.204724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 355/797] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:03 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1681 bytes in 622 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:04.483065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:04.483764 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:04.490009 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:04.490449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:04.491398 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:04.491894 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:04.559498 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:04.567061 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-676b5e71-d4da-48bf-9e16-bc8f7d5a3ee2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1187 microversion: 2.1 time: 0.087837 Jun 23 12:00:04.567631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 443/798] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:04 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1187 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:04.744165 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:04.744982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:04.752707 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:04.753468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:04.754458 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:04.755215 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:04.938124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-ad824bfa-606a-49d9-809c-2f3a08afde98 req-e0fa2c66-b7bd-499e-88e7-b90397dc9807 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d67c82c1-7c40-43a6-9326-480dc5fcb37a", "name": "network-vif-deleted", "tag": "aa6285e7-0658-4131-aef9-e0151dcf7912"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:04.947898 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ad824bfa-606a-49d9-809c-2f3a08afde98 req-e0fa2c66-b7bd-499e-88e7-b90397dc9807 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:04.948620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ad824bfa-606a-49d9-809c-2f3a08afde98 req-e0fa2c66-b7bd-499e-88e7-b90397dc9807 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:04.966263 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-ad824bfa-606a-49d9-809c-2f3a08afde98 req-e0fa2c66-b7bd-499e-88e7-b90397dc9807 service nova] Creating event network-vif-deleted:aa6285e7-0658-4131-aef9-e0151dcf7912 for instance d67c82c1-7c40-43a6-9326-480dc5fcb37a on hv-cinder-82660 Jun 23 12:00:04.971750 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-ad824bfa-606a-49d9-809c-2f3a08afde98 req-e0fa2c66-b7bd-499e-88e7-b90397dc9807 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041711 Jun 23 12:00:04.972936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 444/799] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:04.979437 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:04.980448 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:04.988140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:04.988592 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:04.994002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:04.994840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:05.010271 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:05.019696 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-86048fd5-3761-4e8e-9057-b5e39b98f77a tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.279946 Jun 23 12:00:05.022155 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 356/800] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:04 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:05.163696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:05.174792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ef4f23e8-367f-4885-94ff-dc1cb262e03e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.200279 Jun 23 12:00:05.204845 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 445/801] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:04 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:05.224355 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:05.225762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:05.238710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:05.240044 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:05.241271 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:05.242284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:05.348772 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:05.356984 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fe46dcec-1a97-4d9f-a04d-a6c3511f3e49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 200 len: 1326 microversion: 2.1 time: 0.139324 Jun 23 12:00:05.358548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 357/802] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:05 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 1326 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:05.584855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:05.585453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:05.592773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:05.593462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:05.594400 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:05.594901 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:05.693165 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:05.705317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b4277347-15a6-427b-83e8-7bb6ba4a3ffb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1205 microversion: 2.1 time: 0.124373 Jun 23 12:00:05.715989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 446/803] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:05 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1205 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:06.039260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:06.040480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:06.075692 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.078231 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.081268 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.081838 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.193967 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:06.194619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:06.204587 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.205139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.206178 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.206696 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.364538 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:06.373827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-189a5844-76d0-4fde-a781-871416ef13aa tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.185136 Jun 23 12:00:06.374795 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 447/804] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:06 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:06.379602 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:06.380198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:06.388259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.389411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.390264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.390762 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.399927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:06.405825 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a HTTP/1.1 Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:00:06.407485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:00:06.409130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'd67c82c1-7c40-43a6-9326-480dc5fcb37a'} Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:00:06.409997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:00:06.420264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:00:06.421588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:00:06.421588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-413fd654-7b8a-4cd3-a3dc-3f1037ca4d8f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 404 len: 111 microversion: 2.1 time: 0.032864 Jun 23 12:00:06.421588 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 448/805] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:06 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:00:06.421848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f0e0b8fc-6baa-4812-a7e2-c539c9761bff tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.374839 Jun 23 12:00:06.421848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 358/806] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:06 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:06.422017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ade2fb3e-ddd4-42ce-b5f3-27090718fec6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '.version_select at 0x7f3ae60490d0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:06.436994 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ade2fb3e-ddd4-42ce-b5f3-27090718fec6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722598700" status: 202 len: 0 microversion: 2.1 time: 0.022726 Jun 23 12:00:06.437711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 449/807] 10.222.0.67 () {58 vars in 1220 bytes} [Thu Jun 23 12:00:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1722598700 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:00:06.723384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:06.723987 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:06.731823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.733027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.734877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:06.735318 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:06.959513 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:06.968930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f4710712-73d6-4466-83e6-2cf344332fb8 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.249277 Jun 23 12:00:06.969723 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 359/808] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:06 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:07.040748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-a3816d47-34ad-4f79-915a-1f339ecafa46 req-3bb4ace6-58d8-45f5-90a3-7dc8ced7e298 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9442b025-7b22-40c8-8f76-3a3379bf8e83", "tag": "4f655e92-f7d0-4eb3-aa0d-313d293bd617"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:07.067072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-a3816d47-34ad-4f79-915a-1f339ecafa46 req-3bb4ace6-58d8-45f5-90a3-7dc8ced7e298 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:07.068079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-a3816d47-34ad-4f79-915a-1f339ecafa46 req-3bb4ace6-58d8-45f5-90a3-7dc8ced7e298 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:07.080657 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-a3816d47-34ad-4f79-915a-1f339ecafa46 req-3bb4ace6-58d8-45f5-90a3-7dc8ced7e298 service nova] Creating event network-changed:4f655e92-f7d0-4eb3-aa0d-313d293bd617 for instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 on hv-cinder-82660 Jun 23 12:00:07.087725 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-a3816d47-34ad-4f79-915a-1f339ecafa46 req-3bb4ace6-58d8-45f5-90a3-7dc8ced7e298 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.064091 Jun 23 12:00:07.088777 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 450/809] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:07.142911 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2b49d51d-9994-4a64-b0ed-812fb40890ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: .version_select at 0x7f3aea7caf70>, body: {"keypair": {"name": "tempest-keypair-282459633", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBM4mzpFCoOxYjroPn4yvQvmn6d+OKED92D2306+MiHKV1lx+w/gg1I6qE7BzjGQqMLDmS9jgMZyUGc3HLsnOjwQP49PeEcSgK9mcldifau/LmVQOeoV6tb/fgorEqctxjg=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:07.159125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-2b49d51d-9994-4a64-b0ed-812fb40890ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:00:07.163372 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-2b49d51d-9994-4a64-b0ed-812fb40890ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:00:07.193406 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2b49d51d-9994-4a64-b0ed-812fb40890ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.055823 Jun 23 12:00:07.194041 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 360/810] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 12:00:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:07.392424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:07.393296 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:07.400194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:07.400798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:07.401652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:07.402162 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:07.427387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:07.428306 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:07.434938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:07.435623 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:07.437190 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:07.437474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:07.621350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:07.629377 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-867ce1a1-1275-44b0-8b42-4bf7472a4007 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.241941 Jun 23 12:00:07.639758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 451/811] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:07 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:07.644360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:07.652595 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-96d9b399-6da5-449a-b1fd-63628f2e57bb tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.230141 Jun 23 12:00:07.653207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 361/812] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:07 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:07.987121 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:07.987779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:07.995329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:07.995787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:07.996574 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:07.997041 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:08.197796 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:08.209855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9e1fa524-84a4-4341-ad09-34baf0330da1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.227260 Jun 23 12:00:08.210449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 452/813] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:07 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:08.651377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:08.651927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:08.660979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:08.661744 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:08.662807 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:08.663245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:08.673366 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:08.674205 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:08.683939 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:08.684384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:08.685203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:08.686158 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:08.839906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:08.847938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0c0919ba-95ed-4fe6-b908-4450a78e2814 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1675 microversion: 2.1 time: 0.201604 Jun 23 12:00:08.848516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 362/814] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:08 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1675 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:08.855244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-2043823142", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2860678-188a-43de-956c-7f6a2a5353f6"}], "security_groups": [{"name": "tempest-securitygroup--983501941"}], "key_name": "tempest-keypair-282459633", "user_data": "}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:08.876461 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:08.886672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f93ed447-7ed4-4a72-accf-b1a2402bfcf1 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1754 microversion: 2.1 time: 0.217570 Jun 23 12:00:08.887253 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 453/815] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:08 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1754 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:08.964599 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.network.neutron [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] validate_networks() for [('e2860678-188a-43de-956c-7f6a2a5353f6', None, None, None, None, None)] {{(pid=117747) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:00:09.226185 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:09.226789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:09.234483 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.234930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:09.235702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.236125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:09.380810 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:09.389313 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:00:09.389731 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image limits 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:00:09.389994 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a947a853-16e5-4730-8d92-d062fc6c613d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.167623 Jun 23 12:00:09.390582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 454/816] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:09 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:09.391020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:00:09.391565 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image pref 0:0:0 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:00:09.392104 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.virt.hardware [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117747) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:00:09.401706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.402149 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:09.402943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.403374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:09.425922 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:00:09.429948 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:00:09.441520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Going to run 1 instances... {{(pid=117747) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:00:09.443830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117747) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:00:09.489431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e0c07f15-e621-47e9-9fe9-e70f60f886b8 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.639832 Jun 23 12:00:09.490074 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 363/817] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 12:00:08 2022] POST /compute/v2.1/servers => generated 401 bytes in 641 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 12:00:09.502289 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-90bb7eb6-03b5-4b4c-89c7-10f5369e4b3c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:09.503314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-90bb7eb6-03b5-4b4c-89c7-10f5369e4b3c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:09.559428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-90bb7eb6-03b5-4b4c-89c7-10f5369e4b3c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:09.567172 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-90bb7eb6-03b5-4b4c-89c7-10f5369e4b3c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1241 microversion: 2.1 time: 0.070241 Jun 23 12:00:09.567750 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 455/818] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:09 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1241 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:09.866979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:09.867541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:09.869443 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=5,nova_api:UPDATE=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:09.876660 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.877153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:09.877930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.878370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:09.904300 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:09.905179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:09.910386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=94,nova_api:DELETE=2,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:09.914934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.915469 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:09.916348 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:09.916881 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.020464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:10.029541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a6da699d-928f-4a17-9545-2143277a5715 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1652 microversion: 2.1 time: 0.166328 Jun 23 12:00:10.030280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 364/819] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:09 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1652 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:10.047338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2a73aa54-8f0e-45a9-8b35-8275e27c7d19 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:10.054644 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2a73aa54-8f0e-45a9-8b35-8275e27c7d19 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:10.055431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2a73aa54-8f0e-45a9-8b35-8275e27c7d19 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.081194 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2a73aa54-8f0e-45a9-8b35-8275e27c7d19 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Going to try to start instance {{(pid=117747) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 23 12:00:10.086675 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:10.090174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:10.096921 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ae0259f6-5e15-4362-866e-fd2fb4a80335 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1757 microversion: 2.1 time: 0.197350 Jun 23 12:00:10.097830 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 456/820] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:09 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1757 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:10.139349 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2a73aa54-8f0e-45a9-8b35-8275e27c7d19 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action" status: 202 len: 0 microversion: 2.1 time: 0.096825 Jun 23 12:00:10.139959 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 365/821] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 12:00:10 2022] POST /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/action => generated 0 bytes in 99 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 12:00:10.148421 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:10.149047 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:10.156809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:10.157203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.157971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:10.158408 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.292800 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:10.301574 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-577e38aa-94d8-4b16-a2bd-d4086cc348ec tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1661 microversion: 2.1 time: 0.157012 Jun 23 12:00:10.302233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 457/822] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:10 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1661 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:10.408832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:10.409617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:10.416729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:10.417259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.418164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:10.418748 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.588583 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:10.589687 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:10.602096 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:10.602878 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.604133 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:10.605117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:10.676711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:10.684902 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-66eb350b-4e6f-48ac-9155-7b7a552c05ed tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1299 microversion: 2.1 time: 0.101530 Jun 23 12:00:10.686154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 458/823] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:10 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1299 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:10.777695 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:10.786363 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1654e6ec-90d9-456a-9464-a33e7ddf6769 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.382587 Jun 23 12:00:10.786946 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 366/824] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:10 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:11.318864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:11.319421 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:11.326319 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:11.326761 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:11.327545 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:11.327982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:11.475006 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:11.485170 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-278744be-04d3-4557-b6d5-ffe1a43efeba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1661 microversion: 2.1 time: 0.170103 Jun 23 12:00:11.495097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 459/825] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:11 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1661 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:11.707167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:11.708588 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:11.715685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:11.716138 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:11.721433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:11.721899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:11.802191 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:11.803422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:11.804036 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:11.810598 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-adf57ab5-0b65-4035-aad8-bf654b2ab82a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1299 microversion: 2.1 time: 0.107598 Jun 23 12:00:11.811031 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:11.811450 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 367/826] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:11 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1299 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:11.811593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:11.821082 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:11.823745 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:11.967676 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:11.976807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e7b11858-3859-4922-943b-e867ab118038 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.177169 Jun 23 12:00:11.977801 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 460/827] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:11 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:12.505249 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:12.506655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:12.513349 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:12.513808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:12.514756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:12.515212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:12.727809 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:12.735570 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8ba17862-d268-4ad4-ae07-f7eadd422fe2 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1665 microversion: 2.1 time: 0.237094 Jun 23 12:00:12.736278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 368/828] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:12 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1665 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:12.828861 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:12.829738 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:12.841314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:12.842630 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:12.844373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:12.844966 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:12.865787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-ee089fc3-2fc1-4de6-bccd-07a2b92f8484 req-47aed9a7-5ab8-4ae7-9308-658179e12cce service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429b22b9-be19-4630-80e1-18b745a0eedc", "tag": "c63ff76c-f546-4559-b427-7daf2c346e55"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:12.874859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ee089fc3-2fc1-4de6-bccd-07a2b92f8484 req-47aed9a7-5ab8-4ae7-9308-658179e12cce service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:12.875709 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ee089fc3-2fc1-4de6-bccd-07a2b92f8484 req-47aed9a7-5ab8-4ae7-9308-658179e12cce service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:12.887913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-ee089fc3-2fc1-4de6-bccd-07a2b92f8484 req-47aed9a7-5ab8-4ae7-9308-658179e12cce service nova] Creating event network-changed:c63ff76c-f546-4559-b427-7daf2c346e55 for instance 429b22b9-be19-4630-80e1-18b745a0eedc on hv-cinder-82660 Jun 23 12:00:12.893896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-ee089fc3-2fc1-4de6-bccd-07a2b92f8484 req-47aed9a7-5ab8-4ae7-9308-658179e12cce service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.102911 Jun 23 12:00:12.894507 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 461/829] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:12.994156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:12.994981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:13.002538 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:13.003080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:13.003897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:13.004341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:13.026046 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:13.029702 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:13.034351 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5dc8b4ee-683b-4a1a-a396-2b7f66bc8981 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.210804 Jun 23 12:00:13.035119 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 369/830] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:12 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:13.105163 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:13.146715 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:13.154370 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-21c325cf-ebe2-4789-83c3-04064e95fe59 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.164401 Jun 23 12:00:13.154932 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 462/831] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:12 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:14.052210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:14.052858 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:14.059647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:14.060169 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:14.061182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:14.061625 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:14.171071 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:14.171714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:14.178932 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:14.179239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:14.180021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:14.180456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:14.203231 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:14.210683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ff2fff9f-4e14-4bdf-809a-02beb2bfd3fe tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.162858 Jun 23 12:00:14.211265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 370/832] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:14 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:14.315150 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:14.322672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-84161ba7-21c6-4411-911a-0258843b8f39 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.155622 Jun 23 12:00:14.323239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 463/833] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:14 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:15.228114 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:15.229361 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:15.236226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:15.236697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:15.237493 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:15.237934 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:15.339367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:15.340197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:15.347197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:15.347646 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:15.348417 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:15.348886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:15.466138 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:15.474758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5a8c0d8b-5a12-4266-92b3-3c22a69b56ea tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.250510 Jun 23 12:00:15.475353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 371/834] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:15 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:15.489717 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:15.497731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-42d98db9-7ab0-433e-80ba-18947fae3b92 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.162183 Jun 23 12:00:15.498478 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 464/835] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:15 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:16.491330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:16.491949 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:16.498723 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:16.499221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:16.500200 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:16.500906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:16.514929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:16.515537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:16.522087 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:16.523071 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:16.523436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:16.523989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:16.634571 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:16.644017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-aa6ebe66-a8f1-44da-818d-458f3d401a39 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.156166 Jun 23 12:00:16.644615 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 372/836] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:16 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:16.666985 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:16.675759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6760c68a-258a-49a0-b46e-3e9dc93fb993 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.165138 Jun 23 12:00:16.676331 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 465/837] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:16 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:17.660918 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:17.661530 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:17.668100 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:17.668539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:17.669325 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:17.670377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:17.691283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:17.691900 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:17.698579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:17.699032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:17.699802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:17.700234 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:17.804604 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:17.812237 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4eb7ba68-e966-4e98-8183-a10f7b84de49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.155131 Jun 23 12:00:17.812864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 373/838] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:17 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:17.833140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:17.840656 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-de535646-2541-4e96-8931-ead897c97554 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.153266 Jun 23 12:00:17.841255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 466/839] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:17 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:18.829981 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:18.831323 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:18.842208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:18.843764 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:18.845547 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:18.845999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:18.860310 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:18.860995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:18.871491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:18.871944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:18.872793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:18.873231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:19.025189 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:19.035544 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-53e0e3c2-fa4e-4e3d-96d4-ddaa454d5bf1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.210008 Jun 23 12:00:19.037137 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 374/840] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:18 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:19.060877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-f05581c9-2790-4601-94f1-b6b48ed3366b req-8a57daf6-5c7a-4992-bbf2-21f27f8f04e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442b025-7b22-40c8-8f76-3a3379bf8e83", "name": "network-vif-plugged", "status": "completed", "tag": "4f655e92-f7d0-4eb3-aa0d-313d293bd617"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:19.064741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:19.077883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f05581c9-2790-4601-94f1-b6b48ed3366b req-8a57daf6-5c7a-4992-bbf2-21f27f8f04e4 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:19.078686 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f05581c9-2790-4601-94f1-b6b48ed3366b req-8a57daf6-5c7a-4992-bbf2-21f27f8f04e4 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:19.079549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d5dacd8a-8cf4-4582-b1fd-d0a250e957e1 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.224440 Jun 23 12:00:19.082416 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 467/841] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:18 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:19.099758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-f05581c9-2790-4601-94f1-b6b48ed3366b req-8a57daf6-5c7a-4992-bbf2-21f27f8f04e4 service nova] Creating event network-vif-plugged:4f655e92-f7d0-4eb3-aa0d-313d293bd617 for instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 on hv-cinder-82660 Jun 23 12:00:19.117272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-f05581c9-2790-4601-94f1-b6b48ed3366b req-8a57daf6-5c7a-4992-bbf2-21f27f8f04e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.077946 Jun 23 12:00:19.118421 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 375/842] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:19.119517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:19.120015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:19.127396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:19.130876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:19.130876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:19.130876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:19.224530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lazy-loading 'services' on Instance uuid 7a7bee95-4d0f-4a24-9abc-1d972470a137 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:00:19.302979 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cfd55ae7-5d24-450f-b383-c8b64590c456 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments/8ecaf2b7-aeee-4a22-828c-f793fd65175b" status: 202 len: 0 microversion: 2.1 time: 0.187748 Jun 23 12:00:19.305697 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 468/843] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 12:00:19 2022] DELETE /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments/8ecaf2b7-aeee-4a22-828c-f793fd65175b => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 12:00:19.318373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fe9ed5b1-c38c-416d-bb78-14ad643ee23f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:19.320144 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fe9ed5b1-c38c-416d-bb78-14ad643ee23f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:19.331519 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe9ed5b1-c38c-416d-bb78-14ad643ee23f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:19.332830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe9ed5b1-c38c-416d-bb78-14ad643ee23f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:19.334547 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe9ed5b1-c38c-416d-bb78-14ad643ee23f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:19.335228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fe9ed5b1-c38c-416d-bb78-14ad643ee23f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:19.396157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fe9ed5b1-c38c-416d-bb78-14ad643ee23f tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.085693 Jun 23 12:00:19.396957 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 376/844] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:00:19 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments => generated 197 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:20.051958 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=8 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:20.057342 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:20.058046 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:20.065569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:20.066058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:20.066886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:20.067359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:20.100324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:20.101182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:20.103182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:20.103949 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=12 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:20.111685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:20.112226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:20.113334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:20.113880 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:20.278607 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:20.291059 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1d491fbd-19af-4889-b679-60c3c29416cd tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.240430 Jun 23 12:00:20.292489 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 469/845] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:20 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:20.335638 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:20.346876 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-20ebf75d-8b2a-45bf-af17-4b9a5a665844 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.251442 Jun 23 12:00:20.347483 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 377/846] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:20 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:20.410078 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-618c757d-f242-4170-89b9-ed704ba39911 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:20.411176 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-618c757d-f242-4170-89b9-ed704ba39911 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:20.417547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-618c757d-f242-4170-89b9-ed704ba39911 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:20.418005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-618c757d-f242-4170-89b9-ed704ba39911 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:20.418796 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-618c757d-f242-4170-89b9-ed704ba39911 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:20.419251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-618c757d-f242-4170-89b9-ed704ba39911 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:20.454027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-618c757d-f242-4170-89b9-ed704ba39911 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048346 Jun 23 12:00:20.454620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 470/847] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:00:20 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:21.138093 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-4efcb8fc-ae0b-41cb-a4fc-499721417062 req-df36104d-79b5-487d-bb99-4249cd56dda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429b22b9-be19-4630-80e1-18b745a0eedc", "name": "network-vif-plugged", "status": "completed", "tag": "c63ff76c-f546-4559-b427-7daf2c346e55"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:21.154587 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-4efcb8fc-ae0b-41cb-a4fc-499721417062 req-df36104d-79b5-487d-bb99-4249cd56dda5 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.155373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-4efcb8fc-ae0b-41cb-a4fc-499721417062 req-df36104d-79b5-487d-bb99-4249cd56dda5 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.178447 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-4efcb8fc-ae0b-41cb-a4fc-499721417062 req-df36104d-79b5-487d-bb99-4249cd56dda5 service nova] Creating event network-vif-plugged:c63ff76c-f546-4559-b427-7daf2c346e55 for instance 429b22b9-be19-4630-80e1-18b745a0eedc on hv-cinder-82660 Jun 23 12:00:21.188325 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-4efcb8fc-ae0b-41cb-a4fc-499721417062 req-df36104d-79b5-487d-bb99-4249cd56dda5 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.056957 Jun 23 12:00:21.189440 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 378/848] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:21.316778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:21.317552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:21.323928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.324368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.325159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.325584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.364991 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:21.365701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:21.372472 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.373022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.373956 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.374317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.488133 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:21.496474 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-464fcc98-40bb-45c0-8b00-a7013af564ec tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.183776 Jun 23 12:00:21.498850 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 471/849] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:21 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:21.505878 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fe9c146b-1026-4dea-80a4-9c382f1fd634 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:21.506817 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fe9c146b-1026-4dea-80a4-9c382f1fd634 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:21.513625 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fe9c146b-1026-4dea-80a4-9c382f1fd634 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.514079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fe9c146b-1026-4dea-80a4-9c382f1fd634 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.514855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fe9c146b-1026-4dea-80a4-9c382f1fd634 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.515289 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fe9c146b-1026-4dea-80a4-9c382f1fd634 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.560622 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fe9c146b-1026-4dea-80a4-9c382f1fd634 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.060052 Jun 23 12:00:21.562099 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 472/850] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:00:21 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 12:00:21.570748 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:21.586514 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-51eeb4fc-7f07-4e4d-be33-66d3e4bff26d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1261 microversion: 2.1 time: 0.225646 Jun 23 12:00:21.587114 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 379/851] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:21 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1261 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:21.673802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:21.674397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:21.681541 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.682146 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.682945 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.684090 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.711079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:21.727867 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:00:21.828375 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c9e67c3a-1626-4f5f-89d8-8388528c0683 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 204 len: 0 microversion: 2.1 time: 0.159273 Jun 23 12:00:21.829777 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 473/852] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:00:21 2022] DELETE /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 0 bytes in 162 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:00:21.845926 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:21.846755 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:21.854167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.854758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:21.855798 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:21.856385 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.007697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:22.016200 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9c0b8ced-47cf-46a1-9b67-37433d0c1133 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1688 microversion: 2.1 time: 0.181277 Jun 23 12:00:22.016823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 380/853] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:21 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1688 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:22.313283 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f1f668ab-727b-4b01-8d68-a3035e105fbf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:22.313885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f1f668ab-727b-4b01-8d68-a3035e105fbf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:22.320169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f1f668ab-727b-4b01-8d68-a3035e105fbf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.321352 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f1f668ab-727b-4b01-8d68-a3035e105fbf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.321505 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f1f668ab-727b-4b01-8d68-a3035e105fbf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.321920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f1f668ab-727b-4b01-8d68-a3035e105fbf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.356038 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f1f668ab-727b-4b01-8d68-a3035e105fbf tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments/15387896-7a48-41a8-b921-b4c09d99838f" status: 200 len: 194 microversion: 2.20 time: 0.160844 Jun 23 12:00:22.356639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 474/854] 10.222.0.67 () {60 vars in 1453 bytes} [Thu Jun 23 12:00:22 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments/15387896-7a48-41a8-b921-b4c09d99838f => generated 194 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 12:00:22.434585 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:22.435218 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:22.442342 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.442806 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.443624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.444070 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.522118 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:22.522734 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:22.532496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.533258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.534647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.535296 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.547295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lazy-loading 'services' on Instance uuid e19ec4d3-4ce1-4fbd-81ea-025a5c724421 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:00:22.647823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-578bbbbd-5bab-4988-8a9d-6a7c900f2b38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments/15387896-7a48-41a8-b921-b4c09d99838f" status: 202 len: 0 microversion: 2.20 time: 0.216851 Jun 23 12:00:22.652049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 381/855] 10.222.0.67 () {60 vars in 1456 bytes} [Thu Jun 23 12:00:22 2022] DELETE /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments/15387896-7a48-41a8-b921-b4c09d99838f => generated 0 bytes in 222 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 23 12:00:22.661915 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:22.662627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:22.669460 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.670785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.671601 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.672040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.708773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:22.718631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-209c7c1e-7ba6-4e3e-a5dd-acebe2876574 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.199452 Jun 23 12:00:22.721944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 475/856] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:22 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:22.727713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fc184335-bfeb-49d0-8ed7-c1f39441418c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:22.728769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fc184335-bfeb-49d0-8ed7-c1f39441418c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:22.736186 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc184335-bfeb-49d0-8ed7-c1f39441418c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.736642 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc184335-bfeb-49d0-8ed7-c1f39441418c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.737599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc184335-bfeb-49d0-8ed7-c1f39441418c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.740156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc184335-bfeb-49d0-8ed7-c1f39441418c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.788365 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fc184335-bfeb-49d0-8ed7-c1f39441418c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.064994 Jun 23 12:00:22.789103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 476/857] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 23 12:00:22 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments => generated 197 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 12:00:22.852112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:22.861094 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-61d1b936-64f2-4957-a9a4-897db8414f12 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1444 microversion: 2.1 time: 0.203650 Jun 23 12:00:22.861684 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 382/858] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:22 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1444 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:22.878018 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:22.878631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:22.884925 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.885366 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:22.886137 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:22.886559 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:23.039147 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:23.039147 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:23.045491 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:23.046209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:23.046809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:23.047446 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:23.048471 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:23.054866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-844b8510-5e76-4137-9b4f-c677a9caf3e9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1444 microversion: 2.1 time: 0.181492 Jun 23 12:00:23.056174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 477/859] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:22 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1444 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:23.217984 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:23.226498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7a9e4f99-904c-4574-85fd-b133092ff2b6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1688 microversion: 2.1 time: 0.195600 Jun 23 12:00:23.227084 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 383/860] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:23 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1688 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:23.735541 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:23.736294 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:23.744018 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:23.744472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:23.745278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:23.745714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:23.803172 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0eb6dab8-5384-4dd6-943a-ac5b8ee37e18 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:23.804139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0eb6dab8-5384-4dd6-943a-ac5b8ee37e18 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:23.811179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eb6dab8-5384-4dd6-943a-ac5b8ee37e18 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:23.811632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eb6dab8-5384-4dd6-943a-ac5b8ee37e18 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:23.812414 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eb6dab8-5384-4dd6-943a-ac5b8ee37e18 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:23.812893 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eb6dab8-5384-4dd6-943a-ac5b8ee37e18 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:23.845593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0eb6dab8-5384-4dd6-943a-ac5b8ee37e18 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046396 Jun 23 12:00:23.846140 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 384/861] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 23 12:00:23 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 12:00:23.997277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:24.008374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6b3ca23f-5bea-4263-a271-cc7ebd8bd91c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.276996 Jun 23 12:00:24.009335 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 478/862] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:23 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:24.244264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:24.244929 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:24.251576 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:24.252032 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:24.252883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:24.253334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:24.405697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:24.415327 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-37a5b95b-2016-4fbd-9ab9-a08f9e08b53a tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1688 microversion: 2.1 time: 0.175108 Jun 23 12:00:24.416076 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 385/863] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:24 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:24.861509 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a1bbbcdd-09ad-47d5-a440-f5744930f21f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:24.864348 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a1bbbcdd-09ad-47d5-a440-f5744930f21f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:24.872020 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1bbbcdd-09ad-47d5-a440-f5744930f21f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:24.872465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1bbbcdd-09ad-47d5-a440-f5744930f21f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:24.873970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1bbbcdd-09ad-47d5-a440-f5744930f21f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:24.874404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a1bbbcdd-09ad-47d5-a440-f5744930f21f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:24.905332 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a1bbbcdd-09ad-47d5-a440-f5744930f21f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.051496 Jun 23 12:00:24.905916 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 479/864] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 23 12:00:24 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 12:00:25.026052 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:25.026785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:25.033919 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:25.034398 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:25.035185 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:25.035617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:25.233677 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:25.244992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c7dd0a89-2143-4c41-a40f-ec23ceab3094 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.222711 Jun 23 12:00:25.246641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 386/865] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:25 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:25.348393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-326bbec0-77f0-48cc-ad80-edffb7b9e297 req-d52bf07f-6592-4cee-a9fe-57959dbb9630 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9442b025-7b22-40c8-8f76-3a3379bf8e83", "tag": "4f655e92-f7d0-4eb3-aa0d-313d293bd617"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:25.360595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-326bbec0-77f0-48cc-ad80-edffb7b9e297 req-d52bf07f-6592-4cee-a9fe-57959dbb9630 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:25.361236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-326bbec0-77f0-48cc-ad80-edffb7b9e297 req-d52bf07f-6592-4cee-a9fe-57959dbb9630 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:25.375250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-326bbec0-77f0-48cc-ad80-edffb7b9e297 req-d52bf07f-6592-4cee-a9fe-57959dbb9630 service nova] Creating event network-changed:4f655e92-f7d0-4eb3-aa0d-313d293bd617 for instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 on hv-cinder-82660 Jun 23 12:00:25.381099 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-326bbec0-77f0-48cc-ad80-edffb7b9e297 req-d52bf07f-6592-4cee-a9fe-57959dbb9630 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.106385 Jun 23 12:00:25.381730 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 480/866] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:00:25.435489 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:25.436163 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:25.444619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:25.445107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:25.445890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:25.446327 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:25.452367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:25.667604 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:25.679814 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-88b5223e-3ad2-4760-8e66-53fbf9cdabf6 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1688 microversion: 2.1 time: 0.248721 Jun 23 12:00:25.680720 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 387/867] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:25 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1688 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:25.921864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-74a518da-6edd-457a-bd6a-d678bdfc8cdb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:25.923290 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-74a518da-6edd-457a-bd6a-d678bdfc8cdb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:25.932282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74a518da-6edd-457a-bd6a-d678bdfc8cdb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:25.932804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74a518da-6edd-457a-bd6a-d678bdfc8cdb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:25.933595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74a518da-6edd-457a-bd6a-d678bdfc8cdb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:25.934029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74a518da-6edd-457a-bd6a-d678bdfc8cdb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:25.966502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-74a518da-6edd-457a-bd6a-d678bdfc8cdb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.052034 Jun 23 12:00:25.967095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 481/868] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 23 12:00:25 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments => generated 197 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 12:00:26.264166 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:26.265061 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:26.271552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:26.272013 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:26.272836 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:26.273278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:26.703141 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:26.704033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:26.712462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:26.713054 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:26.713927 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:26.714422 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:26.721932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:26.730139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-23f7d9d4-b95c-4121-969a-5f1de905ffd5 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1366 microversion: 2.1 time: 0.470357 Jun 23 12:00:26.730724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 388/869] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:26 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1366 bytes in 472 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:26.882139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:26.892311 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-53c97abb-48ef-4db3-969e-c48a3167bf63 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1688 microversion: 2.1 time: 0.194350 Jun 23 12:00:26.892932 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 482/870] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:26 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1688 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:26.982370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-07569f0a-8c1e-4244-870e-bd3ca04166c5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:26.983075 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-07569f0a-8c1e-4244-870e-bd3ca04166c5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:26.989303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07569f0a-8c1e-4244-870e-bd3ca04166c5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:26.989839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07569f0a-8c1e-4244-870e-bd3ca04166c5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:26.991051 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07569f0a-8c1e-4244-870e-bd3ca04166c5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:26.991763 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07569f0a-8c1e-4244-870e-bd3ca04166c5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:27.032113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-07569f0a-8c1e-4244-870e-bd3ca04166c5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.054724 Jun 23 12:00:27.033057 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 389/871] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 23 12:00:26 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 12:00:27.755612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:27.756249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:27.764534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:27.765021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:27.765811 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:27.766499 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:27.910230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:27.911066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:27.918132 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:27.918967 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:27.920284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:27.920787 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:27.937920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:27.953608 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-11de8e50-6439-48fc-be88-e4bc51a202ef tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1556 microversion: 2.1 time: 0.199730 Jun 23 12:00:27.968122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 483/872] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:27 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1556 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:27.973204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-40af0ea9-8a06-4e71-bae9-4e4befa470e9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:27.973695 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-40af0ea9-8a06-4e71-bae9-4e4befa470e9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:27.980198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-40af0ea9-8a06-4e71-bae9-4e4befa470e9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:27.980552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-40af0ea9-8a06-4e71-bae9-4e4befa470e9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:27.981339 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-40af0ea9-8a06-4e71-bae9-4e4befa470e9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:27.981772 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-40af0ea9-8a06-4e71-bae9-4e4befa470e9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.019177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:28.027236 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-157521fc-97ec-4e69-a08e-3bdb4260fbec tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1621 microversion: 2.1 time: 0.121582 Jun 23 12:00:28.028010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 390/873] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:27 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1621 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:28.048780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5e7c8410-598e-42f4-aaab-4a331cf14fcb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:28.050271 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5e7c8410-598e-42f4-aaab-4a331cf14fcb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:28.056940 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5e7c8410-598e-42f4-aaab-4a331cf14fcb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:28.057741 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5e7c8410-598e-42f4-aaab-4a331cf14fcb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.058257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5e7c8410-598e-42f4-aaab-4a331cf14fcb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:28.058699 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5e7c8410-598e-42f4-aaab-4a331cf14fcb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.088126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-40af0ea9-8a06-4e71-bae9-4e4befa470e9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.117527 Jun 23 12:00:28.089245 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 484/874] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 12:00:27 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-interface => generated 284 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:28.090865 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5e7c8410-598e-42f4-aaab-4a331cf14fcb tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047123 Jun 23 12:00:28.099497 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 391/875] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 23 12:00:28 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:28.160074 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:28.160614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:28.167169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:28.167619 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.168403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:28.168878 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.198903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:00:28.321957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2b5c8c87-050d-491d-b982-e87e2762d406 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 204 len: 0 microversion: 2.20 time: 0.167820 Jun 23 12:00:28.327316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 485/876] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 23 12:00:28 2022] DELETE /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 12:00:28.332254 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:28.333201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:28.345079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:28.345910 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.346790 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:28.346790 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.359114 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-950ad51e-334a-4984-a406-3240cf7467c5 req-5e4332e7-6253-4dac-976c-a8687cc0fb72 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7a7bee95-4d0f-4a24-9abc-1d972470a137", "name": "network-vif-deleted", "tag": "e482920e-48e2-4b63-930d-1d004fbb0de0"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:28.367813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-950ad51e-334a-4984-a406-3240cf7467c5 req-5e4332e7-6253-4dac-976c-a8687cc0fb72 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:28.368380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-950ad51e-334a-4984-a406-3240cf7467c5 req-5e4332e7-6253-4dac-976c-a8687cc0fb72 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:28.381445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-950ad51e-334a-4984-a406-3240cf7467c5 req-5e4332e7-6253-4dac-976c-a8687cc0fb72 service nova] Creating event network-vif-deleted:e482920e-48e2-4b63-930d-1d004fbb0de0 for instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 on hv-cinder-82660 Jun 23 12:00:28.386559 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-950ad51e-334a-4984-a406-3240cf7467c5 req-5e4332e7-6253-4dac-976c-a8687cc0fb72 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032177 Jun 23 12:00:28.390261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 486/877] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:00:28.534494 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:28.544057 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:28.546213 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:28.547425 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-61db569e-1782-4a9e-b8e7-fa3b3c50dae3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.219171 Jun 23 12:00:28.548580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 392/878] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:28 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:00:29.046317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:29.046969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:29.053944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:29.054194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:29.054945 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:29.055741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:29.162360 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:29.171704 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-db104766-28b1-44d3-be14-4184354df735 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1621 microversion: 2.1 time: 0.130690 Jun 23 12:00:29.172307 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 487/879] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:29 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1621 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:29.271153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-4e53e70b-71c6-4323-b996-9e97e9bbd1e9 req-db2989da-7ca5-4462-a0ed-a1dd5c9b8902 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "429b22b9-be19-4630-80e1-18b745a0eedc", "tag": "c63ff76c-f546-4559-b427-7daf2c346e55"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:29.281254 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-4e53e70b-71c6-4323-b996-9e97e9bbd1e9 req-db2989da-7ca5-4462-a0ed-a1dd5c9b8902 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:29.281868 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-4e53e70b-71c6-4323-b996-9e97e9bbd1e9 req-db2989da-7ca5-4462-a0ed-a1dd5c9b8902 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:29.294286 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-4e53e70b-71c6-4323-b996-9e97e9bbd1e9 req-db2989da-7ca5-4462-a0ed-a1dd5c9b8902 service nova] Creating event network-changed:c63ff76c-f546-4559-b427-7daf2c346e55 for instance 429b22b9-be19-4630-80e1-18b745a0eedc on hv-cinder-82660 Jun 23 12:00:29.300834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-4e53e70b-71c6-4323-b996-9e97e9bbd1e9 req-db2989da-7ca5-4462-a0ed-a1dd5c9b8902 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033757 Jun 23 12:00:29.301844 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 393/880] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:29.566635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:29.567475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:29.575573 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:29.576179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:29.577262 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:29.577669 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:29.601502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:29.751917 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:29.767918 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:29.769502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:29.770732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-49d7a333-2b5e-48c5-bac2-60080c97ddc0 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.208294 Jun 23 12:00:29.771503 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 488/881] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:29 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:30.190924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:30.191645 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:30.199386 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:30.199849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:30.202035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:30.202675 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:30.240842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:30.241304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:30.241770 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lazy-loading 'fault' on Instance uuid 7a7bee95-4d0f-4a24-9abc-1d972470a137 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:00:30.354562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:30.371807 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f29c4300-2404-4a70-bd7f-76c52d09df67 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 200 len: 1334 microversion: 2.1 time: 0.180722 Jun 23 12:00:30.373434 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 394/882] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:30 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 1334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:30.789609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:30.790230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:30.797182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:30.798409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:30.798693 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:30.799129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:30.953178 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:30.961143 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:30.962661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:30.963833 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d39e9653-4571-4938-b46b-66348abbc1f9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1722 microversion: 2.20 time: 0.178268 Jun 23 12:00:30.964393 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 489/883] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:30 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1722 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:31.391943 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:31.392699 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: 7a7bee95-4d0f-4a24-9abc-1d972470a137] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:31.399850 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:31.400347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:31.401412 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:31.401855 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:31.419176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] HTTP exception thrown: Instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 could not be found. Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Request method failure captured: Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 HTTP/1.1 Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSKAAp6qrKeaawTlKefza8FWjHIgItwm35jOuhUXipytjbbMDMJWgWnmVArHcbPZtNrKA4QL87Xmh6HJ89-FiqVjANRs4es7oVQEf9mhxpXOQVOOcMEpy2R0T0Uos278lOZ963Zn_zVlv68QVt1ZGwtNRgH6-xVoOO6N3NX_1DBySM Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:00:31.420896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 53f1188f2446493baae7dc79bbb66ff7 Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 could not be found. Jun 23 12:00:31.422778 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '7a7bee95-4d0f-4a24-9abc-1d972470a137'} Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 could not be found. Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:00:31.424580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 could not be found. Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 could not be found. Jun 23 12:00:31.428210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:31.430385 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Returning 404 to user: Instance 7a7bee95-4d0f-4a24-9abc-1d972470a137 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:00:31.430385 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c100af4f-e591-489e-b0a6-c8555074ab27 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137" status: 404 len: 111 microversion: 2.1 time: 0.036105 Jun 23 12:00:31.430385 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 395/884] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:31 2022] GET /compute/v2.1/servers/7a7bee95-4d0f-4a24-9abc-1d972470a137 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:00:31.431375 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c03f761d-150c-4a8b-a990-ba65d5269a01 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '.version_select at 0x7f3ae63b40d0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:31.454211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c03f761d-150c-4a8b-a990-ba65d5269a01 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-435055559" status: 202 len: 0 microversion: 2.1 time: 0.026562 Jun 23 12:00:31.455103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 490/885] 10.222.0.67 () {58 vars in 1217 bytes} [Thu Jun 23 12:00:31 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-435055559 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:00:31.750584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-33e7ad8c-1dc4-4297-815e-9933a7cb7958 req-1ee0c5e8-8941-4a7a-bc97-b5eef41f3109 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e19ec4d3-4ce1-4fbd-81ea-025a5c724421", "name": "network-vif-deleted", "tag": "8e9b4dc6-7a9c-4183-b1a8-10297c792e0e"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:31.761891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-33e7ad8c-1dc4-4297-815e-9933a7cb7958 req-1ee0c5e8-8941-4a7a-bc97-b5eef41f3109 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:31.762566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-33e7ad8c-1dc4-4297-815e-9933a7cb7958 req-1ee0c5e8-8941-4a7a-bc97-b5eef41f3109 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:31.780924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-33e7ad8c-1dc4-4297-815e-9933a7cb7958 req-1ee0c5e8-8941-4a7a-bc97-b5eef41f3109 service nova] Creating event network-vif-deleted:8e9b4dc6-7a9c-4183-b1a8-10297c792e0e for instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 on hv-cinder-82660 Jun 23 12:00:31.788054 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-33e7ad8c-1dc4-4297-815e-9933a7cb7958 req-1ee0c5e8-8941-4a7a-bc97-b5eef41f3109 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.043199 Jun 23 12:00:31.789350 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 396/886] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:31.984475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:31.985030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:31.993099 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:31.993617 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:31.994541 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:31.995040 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:32.029197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:32.029655 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:32.030174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lazy-loading 'fault' on Instance uuid e19ec4d3-4ce1-4fbd-81ea-025a5c724421 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:00:32.091389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:32.100768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:32.102936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:32.104292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-370a9898-8663-4889-91c4-b0858dfc2105 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 200 len: 1370 microversion: 2.20 time: 0.125081 Jun 23 12:00:32.105413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 491/887] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:31 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 1370 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:33.126212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:33.126915 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:33.133439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:33.133882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:33.134650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:33.135110 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:33.150523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] HTTP exception thrown: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Request method failure captured: Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 HTTP/1.1 Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSPMNO3Oaei6AGjncUJ3c2lTpmCOLsa8mHhLotO7dEO1X8Zw_3e8xtpfqhkKshnrgmMz23rfj-w6Rd6OYvNtZUT5ultiuIVrPrL9Ak43OpoaCyXjKWIJxdRlkIs0B_RU3bMJkbqOc4dCIl4VujqlLDmtOBzzxhT-uKuuzja53erJ2w Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: d211354c655b469491d235e5507e61ba Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:00:33.152242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d211354c655b469491d235e5507e61ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d211354c655b469491d235e5507e61ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: d211354c655b469491d235e5507e61ba Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: ebfb5a6c657a4fd592ff9e67348627eb Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:00:33.154331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'e19ec4d3-4ce1-4fbd-81ea-025a5c724421'} Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:00:33.155688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:00:33.158022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:33.160440 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Returning 404 to user: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:00:33.160440 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-453d311d-82fa-4d22-be55-cee9f8b150b5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 404 len: 111 microversion: 2.20 time: 0.033020 Jun 23 12:00:33.160440 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 397/888] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:33 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:00:33.165907 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ec561c80-7243-4295-8d04-d88ea3803340 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '.version_select at 0x7f3ae60f1430>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:33.185803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ec561c80-7243-4295-8d04-d88ea3803340 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-11104482" status: 204 len: 0 microversion: 2.20 time: 0.023181 Jun 23 12:00:33.186394 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 492/889] 10.222.0.67 () {60 vars in 1255 bytes} [Thu Jun 23 12:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-11104482 => generated 0 bytes in 25 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 12:00:33.880245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-837ff113-4a7b-4987-8c85-bd9525ef4394 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'create', calling method: .version_select at 0x7f3aea807310>, body: {"keypair": {"name": "tempest-keypair-1723804697", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBN6ihTMhlErmBIVkLXleMo9d4rutb1Q3m6BCde6hosODkEhiXJKBeCOhdqh2x8vBx7LTTFr0Sh+ZlL+1sW9YApCwtoxF1w6QOe28BVWHafYvStYCiLi8KyhN6c7rTxG8bw=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:33.895959 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-837ff113-4a7b-4987-8c85-bd9525ef4394 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for project d211354c655b469491d235e5507e61ba. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:00:33.900139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-837ff113-4a7b-4987-8c85-bd9525ef4394 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for user ebfb5a6c657a4fd592ff9e67348627eb and project d211354c655b469491d235e5507e61ba. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:00:33.923604 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-837ff113-4a7b-4987-8c85-bd9525ef4394 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.047032 Jun 23 12:00:33.924126 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 398/890] 10.222.0.67 () {62 vars in 1199 bytes} [Thu Jun 23 12:00:33 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 49 msecs (HTTP/1.1 201) 9 headers in 364 bytes (2 switches on core 0) Jun 23 12:00:34.618347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:34.618996 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:34.625726 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:34.626255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:34.627097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:34.627585 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:34.656121 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:00:34.756130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f42cd1f0-a248-433d-a0c4-63b4e3430072 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "DELETE /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 204 len: 0 microversion: 2.1 time: 0.142093 Jun 23 12:00:34.757051 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 493/891] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:00:34 2022] DELETE /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 0 bytes in 144 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:00:34.766957 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:34.768458 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:34.775795 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:34.776338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:34.777414 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:34.777954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:34.987864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:34.995729 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9ad3c5d7-2f30-41f6-a845-7401133327e1 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1507 microversion: 2.1 time: 0.234348 Jun 23 12:00:34.996334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 399/892] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:34 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1507 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:35.574200 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-2118983472", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "95d2a966-c2d0-4baf-b3af-40bcab8446e6"}], "security_groups": [{"name": "tempest-securitygroup--2086615166"}], "key_name": "tempest-keypair-1723804697", "user_data": "}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:35.583157 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=3,nova_api:DELETE=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:35.687104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] validate_networks() for [('95d2a966-c2d0-4baf-b3af-40bcab8446e6', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:00:36.012232 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:36.012883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:36.019982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:36.020436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:36.021267 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:36.021706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:36.113710 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:00:36.114373 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:00:36.116438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:00:36.117441 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:00:36.118278 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:00:36.141030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:36.141843 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:36.143381 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:36.144963 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:36.166641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for project d211354c655b469491d235e5507e61ba. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:00:36.171026 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Getting quotas for user ebfb5a6c657a4fd592ff9e67348627eb and project d211354c655b469491d235e5507e61ba. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:00:36.183702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:00:36.185583 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:36.187222 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:00:36.195659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b15bc907-b3b5-420a-b975-d207f30eb46c tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1507 microversion: 2.1 time: 0.186843 Jun 23 12:00:36.196326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 400/893] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:36 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1507 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:36.239582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cb4a4c30-672d-4c15-bb01-ff48d3b31a53 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.671152 Jun 23 12:00:36.240251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 494/894] 10.222.0.67 () {62 vars in 1187 bytes} [Thu Jun 23 12:00:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 674 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 23 12:00:36.251009 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8634edaf-fa7a-4b35-b37f-b3ffff62c0a9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:36.251623 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8634edaf-fa7a-4b35-b37f-b3ffff62c0a9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:36.307189 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8634edaf-fa7a-4b35-b37f-b3ffff62c0a9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:36.315819 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8634edaf-fa7a-4b35-b37f-b3ffff62c0a9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:36.317503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8634edaf-fa7a-4b35-b37f-b3ffff62c0a9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:36.318496 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8634edaf-fa7a-4b35-b37f-b3ffff62c0a9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1282 microversion: 2.20 time: 0.072042 Jun 23 12:00:36.328177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 401/895] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:36 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1282 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:36.932613 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-b08c22af-093f-4e02-af5b-f617854989b2 req-fe71c596-25e8-4780-84ca-ed4a940581e2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec85106b-8a3d-4c85-b842-40523a7eb9ca", "name": "network-vif-deleted", "tag": "9ebd518b-a0cf-45b8-bc44-758c460d139b"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:36.943427 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-b08c22af-093f-4e02-af5b-f617854989b2 req-fe71c596-25e8-4780-84ca-ed4a940581e2 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:36.943879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-b08c22af-093f-4e02-af5b-f617854989b2 req-fe71c596-25e8-4780-84ca-ed4a940581e2 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:36.956378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-b08c22af-093f-4e02-af5b-f617854989b2 req-fe71c596-25e8-4780-84ca-ed4a940581e2 service nova] Creating event network-vif-deleted:9ebd518b-a0cf-45b8-bc44-758c460d139b for instance ec85106b-8a3d-4c85-b842-40523a7eb9ca on hv-cinder-82660 Jun 23 12:00:36.961771 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-b08c22af-093f-4e02-af5b-f617854989b2 req-fe71c596-25e8-4780-84ca-ed4a940581e2 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035559 Jun 23 12:00:36.962379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 495/896] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:37.213449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:37.214284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:37.221860 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:37.222310 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:37.223112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:37.223555 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:37.311899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:37.322175 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-618615a3-ed0c-4b52-8070-7a7e4f204c51 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 200 len: 1292 microversion: 2.1 time: 0.112599 Jun 23 12:00:37.323290 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 402/897] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:37 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 1292 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:37.338639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:37.340789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:37.358971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:37.359840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:37.361171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:37.362286 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:37.442979 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:37.451712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:37.453271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:37.454411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1fe904c6-5a72-48b3-a9cd-70cf46e508a3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1342 microversion: 2.20 time: 0.120563 Jun 23 12:00:37.454983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 496/898] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:37 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1342 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:38.340026 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:38.340571 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: ec85106b-8a3d-4c85-b842-40523a7eb9ca] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:38.348250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.349085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.349886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.350531 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.366429 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] HTTP exception thrown: Instance ec85106b-8a3d-4c85-b842-40523a7eb9ca could not be found. Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Request method failure captured: Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca HTTP/1.1 Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSKAAp6qrKeaawTlKefza8FWjHIgItwm35jOuhUXipytjbbMDMJWgWnmVArHcbPZtNrKA4QL87Xmh6HJ89-FiqVjANRs4es7oVQEf9mhxpXOQVOOcMEpy2R0T0Uos278lOZ963Zn_zVlv68QVt1ZGwtNRgH6-xVoOO6N3NX_1DBySM Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:00:38.368010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 53f1188f2446493baae7dc79bbb66ff7 Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance ec85106b-8a3d-4c85-b842-40523a7eb9ca could not be found. Jun 23 12:00:38.369882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'ec85106b-8a3d-4c85-b842-40523a7eb9ca'} Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec85106b-8a3d-4c85-b842-40523a7eb9ca could not be found. Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:00:38.370694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec85106b-8a3d-4c85-b842-40523a7eb9ca could not be found. Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec85106b-8a3d-4c85-b842-40523a7eb9ca could not be found. Jun 23 12:00:38.372347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:38.374816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Returning 404 to user: Instance ec85106b-8a3d-4c85-b842-40523a7eb9ca could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:00:38.374816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e2075401-9d3b-4fc3-9fb5-5392396d5ee0 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca" status: 404 len: 111 microversion: 2.1 time: 0.033973 Jun 23 12:00:38.378462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:38.379211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:38.384690 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 403/899] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:38 2022] GET /compute/v2.1/servers/ec85106b-8a3d-4c85-b842-40523a7eb9ca => generated 111 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:00:38.387173 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.387630 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.388998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.389439 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.418590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:00:38.472878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:38.474666 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:38.481218 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.481892 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.483645 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.484223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.527198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-78f36469-9fd8-42e2-88cb-4c5f14f200f5 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 204 len: 0 microversion: 2.1 time: 0.152088 Jun 23 12:00:38.528445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 497/900] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:00:38 2022] DELETE /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:00:38.539663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:38.540372 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:38.547920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.548636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.549462 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:38.549892 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:38.702381 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:38.710537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4e7edb18-c641-4eda-b868-f2cd2cd25d46 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.177315 Jun 23 12:00:38.711550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 498/901] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:38 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:38.735759 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:38.744259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:38.745821 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:38.746981 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-34b5e83a-5f16-4e29-b6b7-46d1a7cf6002 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.278373 Jun 23 12:00:38.747584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 404/902] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:38 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:00:39.086008 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-357c77df-1f9f-4921-9dd4-5dd045cac889 req-03ad8b43-08c4-4100-a873-43353a664cb7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd3c7247-2686-47a7-96dc-7ffbbe7e7c62", "tag": "b3a6b734-e0ed-4bdf-9b35-b9b65ed45592"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:39.101585 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-357c77df-1f9f-4921-9dd4-5dd045cac889 req-03ad8b43-08c4-4100-a873-43353a664cb7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:39.102360 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-357c77df-1f9f-4921-9dd4-5dd045cac889 req-03ad8b43-08c4-4100-a873-43353a664cb7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:39.121604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-357c77df-1f9f-4921-9dd4-5dd045cac889 req-03ad8b43-08c4-4100-a873-43353a664cb7 service nova] Creating event network-changed:b3a6b734-e0ed-4bdf-9b35-b9b65ed45592 for instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 on hv-cinder-82660 Jun 23 12:00:39.127011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-357c77df-1f9f-4921-9dd4-5dd045cac889 req-03ad8b43-08c4-4100-a873-43353a664cb7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.048214 Jun 23 12:00:39.128542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 499/903] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:39.728016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:39.728613 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:39.735934 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:39.736385 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:39.737185 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:39.737648 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:39.770562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:39.771274 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:39.778472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:39.779522 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:39.780308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:39.780766 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:39.878988 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:39.889441 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8714f7e1-76ab-4302-a771-f39e4f2bf3cd tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.164176 Jun 23 12:00:39.890422 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 405/904] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:39 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:39.927236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:39.936196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:39.937737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:39.938858 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-74ecd2c4-141a-4702-a7a4-16519e03673c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.173043 Jun 23 12:00:39.939427 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 500/905] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:39 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:00:40.908419 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:40.909906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:40.913789 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:40.923534 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:40.923903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:40.924719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:40.925159 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:40.958408 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:40.959016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:40.966984 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:40.967444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:40.968242 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:40.968697 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:41.124734 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:41.133731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:41.135279 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:41.136449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-52330a1e-e753-44a1-b755-b19fcb4368a7 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.182572 Jun 23 12:00:41.137055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 501/906] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:40 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:00:41.246539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:41.254429 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0339d795-2e54-4a40-b72c-d130fe66b18e tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1522 microversion: 2.1 time: 0.351226 Jun 23 12:00:41.264400 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 406/907] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:40 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1522 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:42.155038 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:42.155672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:42.164177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:42.164899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:42.165773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:42.166679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:42.196338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-05e0d20c-8d0b-4c3f-be63-d6f619b871ac req-b8bc55f6-3a01-49d9-9f35-579784a1424f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e63e29e5-ecda-4f38-a06f-ba4d2cf35e50", "name": "network-vif-deleted", "tag": "66465037-49ad-4b75-9a72-74ba5935f37a"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:42.207359 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-05e0d20c-8d0b-4c3f-be63-d6f619b871ac req-b8bc55f6-3a01-49d9-9f35-579784a1424f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:42.207802 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-05e0d20c-8d0b-4c3f-be63-d6f619b871ac req-b8bc55f6-3a01-49d9-9f35-579784a1424f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:42.219899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-05e0d20c-8d0b-4c3f-be63-d6f619b871ac req-b8bc55f6-3a01-49d9-9f35-579784a1424f service nova] Creating event network-vif-deleted:66465037-49ad-4b75-9a72-74ba5935f37a for instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 on hv-cinder-82660 Jun 23 12:00:42.224963 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-05e0d20c-8d0b-4c3f-be63-d6f619b871ac req-b8bc55f6-3a01-49d9-9f35-579784a1424f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032406 Jun 23 12:00:42.225557 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 407/908] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:00:42.273263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:42.274035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:42.281505 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:42.282189 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:42.283009 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:42.283447 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:42.325235 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:42.334528 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:42.336111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:42.337385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8906d199-582d-4ce5-bae7-0d693559e57c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.186455 Jun 23 12:00:42.337955 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 502/909] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:42 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:42.353498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:42.361710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ebbc702e-c077-4ccd-8f5a-b07edc5d43ae tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1480 microversion: 2.1 time: 0.093742 Jun 23 12:00:42.362284 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 408/910] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:42 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1480 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:43.355561 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:43.356345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:43.363434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:43.363886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:43.364664 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:43.365126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:43.380133 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:43.380817 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:43.389045 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:43.389516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:43.390394 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:43.391340 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:43.411530 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=100 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:43.426848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:43.427347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:43.427806 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lazy-loading 'fault' on Instance uuid e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:00:43.475697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '53f1188f2446493baae7dc79bbb66ff7', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9353d04a04ab44e58f56fd01ca43d62e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:43.483572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b49dd50f-e793-4aa3-abb7-786ee0c80e12 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 200 len: 1312 microversion: 2.1 time: 0.107164 Jun 23 12:00:43.484168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 409/911] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:43 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 1312 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:43.512379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:43.521993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:43.523513 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:43.524641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8bf7eccc-20a9-41ff-89d6-cf6617399865 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.173067 Jun 23 12:00:43.525228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 503/912] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:43 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:44.509112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:44.509749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] [instance: e63e29e5-ecda-4f38-a06f-ba4d2cf35e50] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:44.517563 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:44.518016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:44.518801 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:44.519238 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:44.534311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] HTTP exception thrown: Instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 could not be found. Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Request method failure captured: Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 HTTP/1.1 Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSKAAp6qrKeaawTlKefza8FWjHIgItwm35jOuhUXipytjbbMDMJWgWnmVArHcbPZtNrKA4QL87Xmh6HJ89-FiqVjANRs4es7oVQEf9mhxpXOQVOOcMEpy2R0T0Uos278lOZ963Zn_zVlv68QVt1ZGwtNRgH6-xVoOO6N3NX_1DBySM Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:00:44.536007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_9353d04a04ab44e58f56fd01ca43d62e"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 9353d04a04ab44e58f56fd01ca43d62e Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-2128488674 Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 53f1188f2446493baae7dc79bbb66ff7 Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-ServerRescueNegativeTestJSON-2128488674-project Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 could not be found. Jun 23 12:00:44.537670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'e63e29e5-ecda-4f38-a06f-ba4d2cf35e50'} Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 could not be found. Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:00:44.538475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 could not be found. Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 could not be found. Jun 23 12:00:44.540011 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:44.541208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] Returning 404 to user: Instance e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:00:44.541208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d82ac453-00b4-4f82-8c58-d03562adb482 tempest-ServerRescueNegativeTestJSON-2128488674 tempest-ServerRescueNegativeTestJSON-2128488674-project] 10.222.0.67 "GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50" status: 404 len: 111 microversion: 2.1 time: 0.032512 Jun 23 12:00:44.541208 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 410/913] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:44 2022] GET /compute/v2.1/servers/e63e29e5-ecda-4f38-a06f-ba4d2cf35e50 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:00:44.544195 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:44.544855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:44.552320 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:44.552813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:44.553604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:44.554037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:44.721621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:44.730826 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:44.732802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:44.734247 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1ea1085c-5483-4c11-890e-38cde47430c1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.193970 Jun 23 12:00:44.735080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 504/914] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:44 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:00:45.753203 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:45.753836 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:45.760965 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:45.761427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:45.762222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:45.762680 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:46.023691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:46.032340 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:46.033899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:46.035018 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0b17a8ff-300a-4450-b7f9-2e8618837ec4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.285803 Jun 23 12:00:46.035572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 411/915] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:45 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:46.913271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:46.915016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=6 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:46.987369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-1f77f192-1469-42f7-8dfe-8ae23ffddd78 req-dde3903d-3e22-42aa-ba00-03f318b25c7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3c7247-2686-47a7-96dc-7ffbbe7e7c62", "name": "network-vif-plugged", "status": "completed", "tag": "b3a6b734-e0ed-4bdf-9b35-b9b65ed45592"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:46.995740 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-1f77f192-1469-42f7-8dfe-8ae23ffddd78 req-dde3903d-3e22-42aa-ba00-03f318b25c7d service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:46.996187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-1f77f192-1469-42f7-8dfe-8ae23ffddd78 req-dde3903d-3e22-42aa-ba00-03f318b25c7d service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:47.008256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-1f77f192-1469-42f7-8dfe-8ae23ffddd78 req-dde3903d-3e22-42aa-ba00-03f318b25c7d service nova] Creating event network-vif-plugged:b3a6b734-e0ed-4bdf-9b35-b9b65ed45592 for instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 on hv-cinder-82660 Jun 23 12:00:47.013298 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-1f77f192-1469-42f7-8dfe-8ae23ffddd78 req-dde3903d-3e22-42aa-ba00-03f318b25c7d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.106068 Jun 23 12:00:47.014649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 505/916] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:47.054053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:47.055304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:47.057296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=6 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:47.064545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:47.065311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:47.066108 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:47.066737 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:47.261832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:47.271310 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:47.273278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:47.274731 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c65094f1-e509-47f9-ad9f-13b375ed7c74 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.224699 Jun 23 12:00:47.278360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 412/917] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:47 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:48.296645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:48.297414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:48.304200 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:48.304766 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:48.305471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:48.306390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:48.311496 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:00:48.485349 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:48.495277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:48.496829 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:48.498682 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-add5c371-4675-497b-86da-d9e72b2aae64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1408 microversion: 2.20 time: 0.206919 Jun 23 12:00:48.499889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 506/918] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:48 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1408 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:49.519834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:49.521149 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:49.528142 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:49.528877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:49.529864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:49.530593 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:49.701319 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1649003667"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:49.702479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:49.709856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:49.710370 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:49.711159 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:49.711596 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:49.815816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:49.825658 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:49.827601 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:49.829004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-64874856-2b83-4f96-b847-b7bbd329ba11 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1600 microversion: 2.20 time: 0.313184 Jun 23 12:00:49.837570 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 413/919] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:00:49 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1600 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:00:49.849634 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1e4709ce-2e48-41b7-a9fb-eb741fabef64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:49.850139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1e4709ce-2e48-41b7-a9fb-eb741fabef64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:49.858430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1e4709ce-2e48-41b7-a9fb-eb741fabef64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:49.859862 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1e4709ce-2e48-41b7-a9fb-eb741fabef64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:49.860935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1e4709ce-2e48-41b7-a9fb-eb741fabef64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:49.861488 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1e4709ce-2e48-41b7-a9fb-eb741fabef64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:49.877653 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.network.security_group_api [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Removing security group 82610bff-26de-4555-9dc7-20803ba54066 from port 1bf26417-9e61-446b-af12-0f2d3c6c3a6c Jun 23 12:00:50.006804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1e4709ce-2e48-41b7-a9fb-eb741fabef64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.162449 Jun 23 12:00:50.007393 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 414/920] 10.222.0.67 () {60 vars in 1315 bytes} [Thu Jun 23 12:00:49 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-interface => generated 284 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 23 12:00:50.588069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b992862e-b4dd-4b5f-bedd-edf9f6a7a998 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/action" status: 202 len: 0 microversion: 2.1 time: 0.891193 Jun 23 12:00:50.595556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 507/921] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 12:00:49 2022] POST /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/action => generated 0 bytes in 899 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 12:00:50.621421 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-facb6827-0585-4b30-af6f-61a650e8eca8 req-d1271d86-769c-4e7d-9ca1-2c3191761e62 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dde8e4-1b68-42be-ab9d-7a47869a6214", "tag": "1bf26417-9e61-446b-af12-0f2d3c6c3a6c"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:50.670509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-facb6827-0585-4b30-af6f-61a650e8eca8 req-d1271d86-769c-4e7d-9ca1-2c3191761e62 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:50.674056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-facb6827-0585-4b30-af6f-61a650e8eca8 req-d1271d86-769c-4e7d-9ca1-2c3191761e62 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:50.707956 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-facb6827-0585-4b30-af6f-61a650e8eca8 req-d1271d86-769c-4e7d-9ca1-2c3191761e62 service nova] Creating event network-changed:1bf26417-9e61-446b-af12-0f2d3c6c3a6c for instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 on hv-cinder-82660 Jun 23 12:00:50.718054 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-facb6827-0585-4b30-af6f-61a650e8eca8 req-d1271d86-769c-4e7d-9ca1-2c3191761e62 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.105008 Jun 23 12:00:50.718665 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 415/922] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:52.473854 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:52.475261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:52.482771 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:52.483438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:52.484386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:52.485015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:52.485544 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-addf7a43-bba3-4818-b814-6b962d793bef req-0f8e9176-c382-4e14-8a64-bb7de904b3af service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c3dde8e4-1b68-42be-ab9d-7a47869a6214", "tag": "1bf26417-9e61-446b-af12-0f2d3c6c3a6c"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:52.501560 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-addf7a43-bba3-4818-b814-6b962d793bef req-0f8e9176-c382-4e14-8a64-bb7de904b3af service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:52.502446 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-addf7a43-bba3-4818-b814-6b962d793bef req-0f8e9176-c382-4e14-8a64-bb7de904b3af service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:52.518586 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-addf7a43-bba3-4818-b814-6b962d793bef req-0f8e9176-c382-4e14-8a64-bb7de904b3af service nova] Creating event network-changed:1bf26417-9e61-446b-af12-0f2d3c6c3a6c for instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 on hv-cinder-82660 Jun 23 12:00:52.527139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-addf7a43-bba3-4818-b814-6b962d793bef req-0f8e9176-c382-4e14-8a64-bb7de904b3af service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047952 Jun 23 12:00:52.528130 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 416/923] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:52.611399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lazy-loading 'services' on Instance uuid c3dde8e4-1b68-42be-ab9d-7a47869a6214 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:00:52.724887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0f01d195-8b6d-453d-96eb-6d96326fd3c0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments/a1f445d9-7d77-4323-b913-c19a9d628f49" status: 202 len: 0 microversion: 2.1 time: 0.255632 Jun 23 12:00:52.725947 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 508/924] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 12:00:52 2022] DELETE /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments/a1f445d9-7d77-4323-b913-c19a9d628f49 => generated 0 bytes in 258 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:00:52.734985 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-605d5e9b-5f65-404d-b5bc-1555d50fcb7d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:52.736170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-605d5e9b-5f65-404d-b5bc-1555d50fcb7d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:52.758482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-605d5e9b-5f65-404d-b5bc-1555d50fcb7d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:52.759176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-605d5e9b-5f65-404d-b5bc-1555d50fcb7d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:52.760134 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-605d5e9b-5f65-404d-b5bc-1555d50fcb7d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:52.760848 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-605d5e9b-5f65-404d-b5bc-1555d50fcb7d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:52.795222 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-1552b032-179c-4f32-a3c4-a3c99e1f6e42 req-ff9ca356-bf72-4bf5-a684-e471ae8a4b9f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bd3c7247-2686-47a7-96dc-7ffbbe7e7c62", "tag": "b3a6b734-e0ed-4bdf-9b35-b9b65ed45592"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:52.811225 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-1552b032-179c-4f32-a3c4-a3c99e1f6e42 req-ff9ca356-bf72-4bf5-a684-e471ae8a4b9f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:52.812549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-1552b032-179c-4f32-a3c4-a3c99e1f6e42 req-ff9ca356-bf72-4bf5-a684-e471ae8a4b9f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:52.840293 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-1552b032-179c-4f32-a3c4-a3c99e1f6e42 req-ff9ca356-bf72-4bf5-a684-e471ae8a4b9f service nova] Creating event network-changed:b3a6b734-e0ed-4bdf-9b35-b9b65ed45592 for instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 on hv-cinder-82660 Jun 23 12:00:52.850313 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-1552b032-179c-4f32-a3c4-a3c99e1f6e42 req-ff9ca356-bf72-4bf5-a684-e471ae8a4b9f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.075104 Jun 23 12:00:52.850915 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 509/925] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:52 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:52.868516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-605d5e9b-5f65-404d-b5bc-1555d50fcb7d tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.138173 Jun 23 12:00:52.869755 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 417/926] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:00:52 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments => generated 197 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:00:53.882457 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d898c610-0557-4de7-89bc-6a278301cb71 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:53.883473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d898c610-0557-4de7-89bc-6a278301cb71 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:53.891700 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d898c610-0557-4de7-89bc-6a278301cb71 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:53.892664 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d898c610-0557-4de7-89bc-6a278301cb71 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:53.893510 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d898c610-0557-4de7-89bc-6a278301cb71 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:53.893968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d898c610-0557-4de7-89bc-6a278301cb71 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:53.936194 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d898c610-0557-4de7-89bc-6a278301cb71 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057760 Jun 23 12:00:53.936716 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 510/927] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:00:53 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 12:00:53.946510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:53.947021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:53.954335 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:53.954792 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:53.955569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:53.956006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:54.033783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] HTTP exception thrown: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 is not attached to volume a1f445d9-7d77-4323-b913-c19a9d628f49 Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Request method failure captured: Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments/a1f445d9-7d77-4323-b913-c19a9d628f49 HTTP/1.1 Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFUpZN6O4YwLljUBjjRXYAWwwMz_ifk_dxj8Z3Krfh7I-S1dvkEvykZT0WrFelMTKyGkQg9MtNwtJv5zAU7c6df3l7q8oC7Zti0A588dNRCeTRXnJLqUNUaZhVXmKcnkvSp22IBGLzAwiI24NytF_V5a0Fc7j0btn0ZN8Pug3S2D2xg Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 45aa73614bc447bdb1bfda38ad541ab3 Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-TestMinimumBasicScenario-362085252 Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:00:54.039703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-TestMinimumBasicScenario-362085252 Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 45aa73614bc447bdb1bfda38ad541ab3 Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-TestMinimumBasicScenario-362085252 Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-TestMinimumBasicScenario-362085252-project Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 2658206b0a934bd8861a49701ab41659 Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-TestMinimumBasicScenario-362085252-project Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:00:54.041474 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 is not attached to volume a1f445d9-7d77-4323-b913-c19a9d628f49 Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'server_id': 'c3dde8e4-1b68-42be-ab9d-7a47869a6214', 'id': 'a1f445d9-7d77-4323-b913-c19a9d628f49'} Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id a1f445d9-7d77-4323-b913-c19a9d628f49. Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:00:54.042353 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 is not attached to volume a1f445d9-7d77-4323-b913-c19a9d628f49 Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 is not attached to volume a1f445d9-7d77-4323-b913-c19a9d628f49 Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:00:54.043826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Returning 404 to user: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 is not attached to volume a1f445d9-7d77-4323-b913-c19a9d628f49 {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:00:54.044897 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8e981bae-7a81-4388-896b-d60977c0ce15 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments/a1f445d9-7d77-4323-b913-c19a9d628f49" status: 404 len: 154 microversion: 2.1 time: 0.098634 Jun 23 12:00:54.045176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 418/928] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 12:00:53 2022] DELETE /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214/os-volume_attachments/a1f445d9-7d77-4323-b913-c19a9d628f49 => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:00:55.180851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:55.181338 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:55.187907 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:55.188353 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:55.189149 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:55.189582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:55.215784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:00:55.290816 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fb241500-73fd-4d00-8591-777c24584e84 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "DELETE /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 204 len: 0 microversion: 2.1 time: 0.113605 Jun 23 12:00:55.291643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 511/929] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:00:55 2022] DELETE /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 0 bytes in 115 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:00:55.301343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:55.302558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:55.311101 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:55.311582 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:55.312614 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:55.314302 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:55.445079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:55.453228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-50fd98f4-9ac8-4deb-9c7b-70d3356543b2 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1552 microversion: 2.1 time: 0.156147 Jun 23 12:00:55.453805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 419/930] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:55 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1552 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:56.049079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-31c52a91-8447-44b9-8cfc-b7a971bb73c1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:56.050195 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-31c52a91-8447-44b9-8cfc-b7a971bb73c1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:56.056081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31c52a91-8447-44b9-8cfc-b7a971bb73c1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.056530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31c52a91-8447-44b9-8cfc-b7a971bb73c1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.057327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31c52a91-8447-44b9-8cfc-b7a971bb73c1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.057763 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-31c52a91-8447-44b9-8cfc-b7a971bb73c1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.090448 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-31c52a91-8447-44b9-8cfc-b7a971bb73c1 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047305 Jun 23 12:00:56.091095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 512/931] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:00:56 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 12:00:56.151725 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:56.152292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:56.159073 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.159359 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.160167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.160634 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.185516 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:00:56.262393 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-380eefb0-50f3-41a1-9fc4-270a74aaf1f4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 204 len: 0 microversion: 2.1 time: 0.114210 Jun 23 12:00:56.263495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 420/932] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:00:56 2022] DELETE /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 23 12:00:56.271834 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:56.272579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:56.279654 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.280103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.280906 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.281344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.414359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:56.422139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-55ba4514-25c3-4450-bf08-e693bdf1abbe tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1671 microversion: 2.1 time: 0.154239 Jun 23 12:00:56.422721 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 513/933] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:56 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1671 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:56.471441 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:56.472197 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:56.479093 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.479546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.480335 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:56.480808 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:56.625550 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:56.633092 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9a804f0c-e2ed-4ea2-a3b4-154e45bb2cb3 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1552 microversion: 2.1 time: 0.165802 Jun 23 12:00:56.633653 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 421/934] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:56 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1552 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:57.439597 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:57.440237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:57.446784 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:57.447236 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:57.448071 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:57.448471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:57.581250 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:57.588960 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e694a996-fe96-48cc-9cf4-2c6c511754e4 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1671 microversion: 2.1 time: 0.153201 Jun 23 12:00:57.589532 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 514/935] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:57 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1671 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:57.650102 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:57.650758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:57.658012 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:57.658462 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:57.659239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:57.659765 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:57.789111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:57.796724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d2fb5ce4-d10c-4068-8e46-81c5f38898b0 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1552 microversion: 2.1 time: 0.150466 Jun 23 12:00:57.797394 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 422/936] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:57 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1552 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:58.606613 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:58.607961 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:58.615107 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:58.615621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:58.616481 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:58.617029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:58.768055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:58.777060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4bf47722-231d-4fa5-abc4-acfaacb72b7d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1671 microversion: 2.1 time: 0.174000 Jun 23 12:00:58.777889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 515/937] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:58 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1671 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:00:58.814256 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:58.815457 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:58.822333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:58.823088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:58.823889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:58.824323 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:59.261584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-e5d1d091-c4e4-4a24-a071-2539f7a100ff req-105cbbb7-f9ae-4712-9a20-5ed8eb522690 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c3dde8e4-1b68-42be-ab9d-7a47869a6214", "name": "network-vif-deleted", "tag": "1bf26417-9e61-446b-af12-0f2d3c6c3a6c"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:00:59.269712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '2658206b0a934bd8861a49701ab41659', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45aa73614bc447bdb1bfda38ad541ab3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:59.273612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-e5d1d091-c4e4-4a24-a071-2539f7a100ff req-105cbbb7-f9ae-4712-9a20-5ed8eb522690 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:59.274274 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-e5d1d091-c4e4-4a24-a071-2539f7a100ff req-105cbbb7-f9ae-4712-9a20-5ed8eb522690 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:59.278487 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-305b788b-c8bc-4140-ad90-81d7596d5476 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 200 len: 1552 microversion: 2.1 time: 0.467909 Jun 23 12:00:59.280006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 423/938] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:58 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 1552 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:00:59.292926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-e5d1d091-c4e4-4a24-a071-2539f7a100ff req-105cbbb7-f9ae-4712-9a20-5ed8eb522690 service nova] Creating event network-vif-deleted:1bf26417-9e61-446b-af12-0f2d3c6c3a6c for instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 on hv-cinder-82660 Jun 23 12:00:59.300117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-e5d1d091-c4e4-4a24-a071-2539f7a100ff req-105cbbb7-f9ae-4712-9a20-5ed8eb522690 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.042304 Jun 23 12:00:59.300993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 516/939] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:00:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:00:59.796148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:00:59.796942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:00:59.807971 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:59.808434 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:59.809252 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:59.809694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:59.878921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:00:59.879467 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:00:59.879713 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lazy-loading 'fault' on Instance uuid 7134bd36-8b37-48ff-bcfb-ab369c0ef601 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:00:59.977746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:00:59.986310 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e9448251-daa7-4744-ab16-91b1713e6cd8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 200 len: 1326 microversion: 2.1 time: 0.194698 Jun 23 12:00:59.987123 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 424/940] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:00:59 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 1326 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:00.298413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:00.299431 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] [instance: c3dde8e4-1b68-42be-ab9d-7a47869a6214] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:00.306140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:00.306824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:00.307587 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:00.308155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:00.323080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] HTTP exception thrown: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 could not be found. Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Request method failure captured: Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 HTTP/1.1 Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFUpZN6O4YwLljUBjjRXYAWwwMz_ifk_dxj8Z3Krfh7I-S1dvkEvykZT0WrFelMTKyGkQg9MtNwtJv5zAU7c6df3l7q8oC7Zti0A588dNRCeTRXnJLqUNUaZhVXmKcnkvSp22IBGLzAwiI24NytF_V5a0Fc7j0btn0ZN8Pug3S2D2xg Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: 45aa73614bc447bdb1bfda38ad541ab3 Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-TestMinimumBasicScenario-362085252 Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:01:00.325034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_45aa73614bc447bdb1bfda38ad541ab3"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-TestMinimumBasicScenario-362085252 Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: 45aa73614bc447bdb1bfda38ad541ab3 Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-TestMinimumBasicScenario-362085252 Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-TestMinimumBasicScenario-362085252-project Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 2658206b0a934bd8861a49701ab41659 Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-TestMinimumBasicScenario-362085252-project Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 could not be found. Jun 23 12:01:00.326645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'c3dde8e4-1b68-42be-ab9d-7a47869a6214'} Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 could not be found. Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:01:00.327534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 could not be found. Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 could not be found. Jun 23 12:01:00.329001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:00.331652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Returning 404 to user: Instance c3dde8e4-1b68-42be-ab9d-7a47869a6214 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:01:00.332930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0feabece-b488-4c59-a146-b59e8dc05c9b tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214" status: 404 len: 111 microversion: 2.1 time: 0.039929 Jun 23 12:01:00.333780 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 517/941] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:00 2022] GET /compute/v2.1/servers/c3dde8e4-1b68-42be-ab9d-7a47869a6214 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:01:00.342265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e6aa7c9b-fb92-43a8-89c9-1710295b8049 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] Calling method '.version_select at 0x7f3ae5fb6550>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:00.398636 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e6aa7c9b-fb92-43a8-89c9-1710295b8049 tempest-TestMinimumBasicScenario-362085252 tempest-TestMinimumBasicScenario-362085252-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-682795558" status: 202 len: 0 microversion: 2.1 time: 0.060240 Jun 23 12:01:00.399959 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 425/942] 10.222.0.67 () {58 vars in 1268 bytes} [Thu Jun 23 12:01:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-682795558 => generated 0 bytes in 62 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:01:01.004051 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:01.004704 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:01.011335 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:01.011764 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:01.012762 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:01.013397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:01.030252 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] HTTP exception thrown: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Request method failure captured: Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 HTTP/1.1 Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSUIjBx_dL752zPMuUaB_COk_lLic2QQ9fZPZ3sK79QRQRbPgLSZh0lryrfYdU-n_4Eymga-Fs3UvxxcH4x7x3RwHaAa7XwA0xOi6XKUDC2avlKdQrNADhvHSSnX8XOg80f5mKDAdhgCYx1XF2mGWjrSxuLFLt2BKX0vkVOStN3VeM Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:01:01.031839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9ab84989dd384d15b316b20cc65e792a Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:01:01.033807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '7134bd36-8b37-48ff-bcfb-ab369c0ef601'} Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:01:01.034998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:01:01.036647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:01.037926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Returning 404 to user: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:01:01.037926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cb7fb9b7-c15a-4a56-9e4c-875f91bf27e7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 404 len: 111 microversion: 2.1 time: 0.033932 Jun 23 12:01:01.037926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 518/943] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:00 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:01:01.043007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c0864a81-90ac-4c88-954e-0ca65d1fcf73 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '.version_select at 0x7f3ae5f4e940>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:01.082552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c0864a81-90ac-4c88-954e-0ca65d1fcf73 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-238375666" status: 202 len: 0 microversion: 2.1 time: 0.043426 Jun 23 12:01:01.082775 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 426/944] 10.222.0.67 () {58 vars in 1217 bytes} [Thu Jun 23 12:01:01 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-238375666 => generated 0 bytes in 45 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:01:01.352411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-30fc2ae9-2a64-49cf-a6a7-e7894b73affd req-87308307-072d-42d5-b004-6fee9be3d484 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7134bd36-8b37-48ff-bcfb-ab369c0ef601", "name": "network-vif-deleted", "tag": "2b1b9605-d448-4f5e-8b07-f5d1a8bf6799"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:01.363229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-30fc2ae9-2a64-49cf-a6a7-e7894b73affd req-87308307-072d-42d5-b004-6fee9be3d484 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:01.363929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-30fc2ae9-2a64-49cf-a6a7-e7894b73affd req-87308307-072d-42d5-b004-6fee9be3d484 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:01.380399 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-30fc2ae9-2a64-49cf-a6a7-e7894b73affd req-87308307-072d-42d5-b004-6fee9be3d484 service nova] Creating event network-vif-deleted:2b1b9605-d448-4f5e-8b07-f5d1a8bf6799 for instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 on hv-cinder-82660 Jun 23 12:01:01.386279 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-30fc2ae9-2a64-49cf-a6a7-e7894b73affd req-87308307-072d-42d5-b004-6fee9be3d484 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037430 Jun 23 12:01:01.387847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 519/945] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:02.120485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a5fa5542-2b8f-4182-80d0-d9dfea221d96 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'create', calling method: .version_select at 0x7f3ae6030820>, body: {"keypair": {"name": "tempest-keypair-183096472", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLoPx4vNnPL6XiobQ6+Y4kcmGeAgwXfRr2m7PrtBh59eaXDiUMJZT1uDZi0eKcheS8SKXjnOd00J1cBPlc3EJQsjva68yWIU09B9QLmORBO+rBXFSqRc/noor8VMxSL5dA=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:02.137465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-a5fa5542-2b8f-4182-80d0-d9dfea221d96 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:01:02.143101 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-a5fa5542-2b8f-4182-80d0-d9dfea221d96 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for user 9ab84989dd384d15b316b20cc65e792a and project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:01:02.167730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a5fa5542-2b8f-4182-80d0-d9dfea221d96 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.051707 Jun 23 12:01:02.174546 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 427/946] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 12:01:02 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:04.096701 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1234180493", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "6ec90cf8-67c4-41e3-bbbb-0e606173a369"}], "security_groups": [{"name": "tempest-securitygroup--1869290579"}], "key_name": "tempest-keypair-183096472", "user_data": "}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:04.275595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] validate_networks() for [('6ec90cf8-67c4-41e3-bbbb-0e606173a369', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:01:05.078915 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:01:05.079604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:01:05.080192 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:01:05.081002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:01:05.081355 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:01:05.099800 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:05.105228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:05.106775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:05.108898 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:05.138595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:01:05.143532 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Getting quotas for user 9ab84989dd384d15b316b20cc65e792a and project a1a92a7ffc864256b48a9848b27f9fd2. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:01:05.157231 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:01:05.159646 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:01:05.206986 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b2750477-874a-44b6-a1b0-cc87c87c744d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.116254 Jun 23 12:01:05.207643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 520/947] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 12:01:04 2022] POST /compute/v2.1/servers => generated 402 bytes in 1119 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 12:01:05.221006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-72833d2e-6390-4cea-907c-39c59239c871 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:05.221688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-72833d2e-6390-4cea-907c-39c59239c871 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:05.616485 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-72833d2e-6390-4cea-907c-39c59239c871 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:05.624096 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-72833d2e-6390-4cea-907c-39c59239c871 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1237 microversion: 2.1 time: 0.409281 Jun 23 12:01:05.624706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 428/948] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:05 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1237 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:06.641666 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:06.642336 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:06.645620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=89,nova_api:INSERT=6,nova_api:UPDATE=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:06.650060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:06.650508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:06.651271 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:06.651698 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:06.719930 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:06.727499 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-609804a6-fce4-4d07-8775-776e09284e4c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1295 microversion: 2.1 time: 0.090229 Jun 23 12:01:06.728093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 521/949] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:06 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1295 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:07.745550 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:07.747454 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:07.777687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:07.778170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:07.779087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:07.779537 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:08.082085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:08.091727 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7be386d9-d104-43a4-9f24-bf99c1b6704f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.350368 Jun 23 12:01:08.093739 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 429/950] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:07 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:08.531179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-98b96b3d-6e9f-4b1c-8067-d9cfacb4de00 req-fd3590e8-1063-4c79-9521-8d6c4f8e012d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55cdb509-57bb-458f-969a-99f8da10eea5", "tag": "4bdd1459-2b27-4ac0-9b5f-00e9113b956f"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:08.540515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-98b96b3d-6e9f-4b1c-8067-d9cfacb4de00 req-fd3590e8-1063-4c79-9521-8d6c4f8e012d service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:08.548836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-98b96b3d-6e9f-4b1c-8067-d9cfacb4de00 req-fd3590e8-1063-4c79-9521-8d6c4f8e012d service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:08.562300 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-98b96b3d-6e9f-4b1c-8067-d9cfacb4de00 req-fd3590e8-1063-4c79-9521-8d6c4f8e012d service nova] Creating event network-changed:4bdd1459-2b27-4ac0-9b5f-00e9113b956f for instance 55cdb509-57bb-458f-969a-99f8da10eea5 on hv-cinder-82660 Jun 23 12:01:08.569534 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-98b96b3d-6e9f-4b1c-8067-d9cfacb4de00 req-fd3590e8-1063-4c79-9521-8d6c4f8e012d service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.043134 Jun 23 12:01:08.570139 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 522/951] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:09.115015 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:09.115648 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:09.124697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:09.125427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:09.126578 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:09.127023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:09.131505 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:09.308176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:09.317755 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c99fda0d-a017-44e7-a0da-e34c916b8102 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.212823 Jun 23 12:01:09.318428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 430/952] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:09 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:10.342187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:10.349477 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:10.366660 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:10.368058 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:10.370367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:10.370896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:10.596121 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:10.610672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-96f6f964-7d2f-475f-8079-d16011682620 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.278814 Jun 23 12:01:10.617413 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 523/953] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:10 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:11.628280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:11.628921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:11.631285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:DELETE=2,nova_api:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:11.636756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:11.637211 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:11.637984 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:11.638424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:11.784202 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:11.791934 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d49cc27b-7a9d-4b23-ba64-e48bf272142e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.167464 Jun 23 12:01:11.792504 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 431/954] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:11 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:12.810118 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:12.810730 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:12.817330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:12.817783 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:12.818552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:12.818988 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:12.956732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:12.964521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7b9bdce2-567d-4aee-be92-917e75445e2d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.158352 Jun 23 12:01:12.965151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 524/955] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:12 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:13.051600 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d72aee0f-c080-4381-b198-a139f310c2b4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:13.052151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d72aee0f-c080-4381-b198-a139f310c2b4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:13.059078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d72aee0f-c080-4381-b198-a139f310c2b4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:13.059543 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d72aee0f-c080-4381-b198-a139f310c2b4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:13.060451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d72aee0f-c080-4381-b198-a139f310c2b4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:13.061066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d72aee0f-c080-4381-b198-a139f310c2b4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:13.087979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d72aee0f-c080-4381-b198-a139f310c2b4 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/ips" status: 200 len: 149 microversion: 2.1 time: 0.040498 Jun 23 12:01:13.088640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 432/956] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 12:01:13 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/ips => generated 149 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:13.981897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:13.982510 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:13.989039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:13.989494 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:13.990267 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:13.990707 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:14.008548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:14.124372 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:14.132230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-89e874a7-d891-4019-bdbd-62d2e21579f8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.154186 Jun 23 12:01:14.132831 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 525/957] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:13 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:14.442889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fb2e1b13-aa5d-4f50-9b61-01bde9c1ed94 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6766fc0e-23e7-4f53-838f-c005fbab80e6"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:14.444015 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fb2e1b13-aa5d-4f50-9b61-01bde9c1ed94 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:14.450713 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fb2e1b13-aa5d-4f50-9b61-01bde9c1ed94 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:14.451167 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fb2e1b13-aa5d-4f50-9b61-01bde9c1ed94 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:14.452483 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fb2e1b13-aa5d-4f50-9b61-01bde9c1ed94 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:14.452945 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fb2e1b13-aa5d-4f50-9b61-01bde9c1ed94 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:14.701035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fb2e1b13-aa5d-4f50-9b61-01bde9c1ed94 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.261899 Jun 23 12:01:14.701852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 433/958] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 12:01:14 2022] POST /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments => generated 194 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:15.037591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-c2d940c8-83bf-4e16-8589-9478fc674fa0 req-9f9cab6c-4c0e-4528-a59a-6b9d9af94346 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55cdb509-57bb-458f-969a-99f8da10eea5", "name": "network-vif-plugged", "status": "completed", "tag": "4bdd1459-2b27-4ac0-9b5f-00e9113b956f"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:15.049253 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-c2d940c8-83bf-4e16-8589-9478fc674fa0 req-9f9cab6c-4c0e-4528-a59a-6b9d9af94346 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:15.050045 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-c2d940c8-83bf-4e16-8589-9478fc674fa0 req-9f9cab6c-4c0e-4528-a59a-6b9d9af94346 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:15.073989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-c2d940c8-83bf-4e16-8589-9478fc674fa0 req-9f9cab6c-4c0e-4528-a59a-6b9d9af94346 service nova] Creating event network-vif-plugged:4bdd1459-2b27-4ac0-9b5f-00e9113b956f for instance 55cdb509-57bb-458f-969a-99f8da10eea5 on hv-cinder-82660 Jun 23 12:01:15.084237 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-c2d940c8-83bf-4e16-8589-9478fc674fa0 req-9f9cab6c-4c0e-4528-a59a-6b9d9af94346 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050056 Jun 23 12:01:15.085415 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 526/959] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:01:15.152567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:15.153764 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:15.162380 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:15.163101 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:15.164275 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:15.164926 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:15.366589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:15.374972 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-94de54f2-6533-432f-bae8-80e67c7cb39f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.228532 Jun 23 12:01:15.375547 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 434/960] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:15 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:16.392351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:16.393090 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:16.395085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:16.395746 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=6 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:16.402549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:16.403001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:16.403785 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:16.404223 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:16.543551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:16.551904 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-edf4c571-c0b7-48d0-bde5-a46630a2c40a tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1363 microversion: 2.1 time: 0.163816 Jun 23 12:01:16.552506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 527/961] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:16 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1363 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:17.568197 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:17.568832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:17.571210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=6 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:17.577242 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:17.577691 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:17.578464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:17.578896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:17.712034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:17.719857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6bcc497a-6310-4d1f-a350-a319b522d2bd tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1547 microversion: 2.1 time: 0.155575 Jun 23 12:01:17.720428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 435/962] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:17 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1547 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:17.743460 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a47fa4d0-4c2e-49cd-b3c8-023febac447d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:17.744078 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a47fa4d0-4c2e-49cd-b3c8-023febac447d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:17.751599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a47fa4d0-4c2e-49cd-b3c8-023febac447d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:17.752064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a47fa4d0-4c2e-49cd-b3c8-023febac447d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:17.752905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a47fa4d0-4c2e-49cd-b3c8-023febac447d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:17.753332 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a47fa4d0-4c2e-49cd-b3c8-023febac447d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:17.830794 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a47fa4d0-4c2e-49cd-b3c8-023febac447d tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091152 Jun 23 12:01:17.831384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 528/963] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 12:01:17 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:19.021066 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-7e853cde-00fb-4fdc-a41b-c5cbade979fd req-2f130bc4-f103-4e77-85aa-d90d74205129 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "55cdb509-57bb-458f-969a-99f8da10eea5", "tag": "4bdd1459-2b27-4ac0-9b5f-00e9113b956f"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:19.030252 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-7e853cde-00fb-4fdc-a41b-c5cbade979fd req-2f130bc4-f103-4e77-85aa-d90d74205129 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:19.030916 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-7e853cde-00fb-4fdc-a41b-c5cbade979fd req-2f130bc4-f103-4e77-85aa-d90d74205129 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:19.042047 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-7e853cde-00fb-4fdc-a41b-c5cbade979fd req-2f130bc4-f103-4e77-85aa-d90d74205129 service nova] Creating event network-changed:4bdd1459-2b27-4ac0-9b5f-00e9113b956f for instance 55cdb509-57bb-458f-969a-99f8da10eea5 on hv-cinder-82660 Jun 23 12:01:19.048545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-7e853cde-00fb-4fdc-a41b-c5cbade979fd req-2f130bc4-f103-4e77-85aa-d90d74205129 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030708 Jun 23 12:01:19.049174 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 436/964] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:01:21.170199 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6766fc0e-23e7-4f53-838f-c005fbab80e6"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:21.171261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:21.177708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:21.178156 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:21.178944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:21.179385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:21.256934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Invalid volume: volume 6766fc0e-23e7-4f53-838f-c005fbab80e6 is already attached to instances: 429b22b9-be19-4630-80e1-18b745a0eedc Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: POST /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments HTTP/1.1 Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 74 Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:01:21.258677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {"volumeAttachment": {"volumeId": "6766fc0e-23e7-4f53-838f-c005fbab80e6"}} Jun 23 12:01:21.260386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Invalid volume: volume 6766fc0e-23e7-4f53-838f-c005fbab80e6 is already attached to instances: 429b22b9-be19-4630-80e1-18b745a0eedc Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'server_id': '429b22b9-be19-4630-80e1-18b745a0eedc', 'body': {'volumeAttachment': {'volumeId': '6766fc0e-23e7-4f53-838f-c005fbab80e6'}}} Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6766fc0e-23e7-4f53-838f-c005fbab80e6 is already attached to instances: 429b22b9-be19-4630-80e1-18b745a0eedc Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:21.261639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6766fc0e-23e7-4f53-838f-c005fbab80e6 is already attached to instances: 429b22b9-be19-4630-80e1-18b745a0eedc Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:21.263123 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6766fc0e-23e7-4f53-838f-c005fbab80e6 is already attached to instances: 429b22b9-be19-4630-80e1-18b745a0eedc Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 400 to user: Invalid volume: volume 6766fc0e-23e7-4f53-838f-c005fbab80e6 is already attached to instances: 429b22b9-be19-4630-80e1-18b745a0eedc {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1370074f-184f-432a-86c6-377acfb0b57f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.094513 Jun 23 12:01:21.266432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 529/965] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 12:01:21 2022] POST /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments => generated 174 bytes in 96 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:01:21.321697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:21.322283 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:21.329542 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:21.329989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:21.330750 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:21.331178 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:21.412601 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lazy-loading 'services' on Instance uuid 429b22b9-be19-4630-80e1-18b745a0eedc {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:01:21.487477 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-20cfade7-da17-4a19-aaac-31d0c20a36ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments/6766fc0e-23e7-4f53-838f-c005fbab80e6" status: 202 len: 0 microversion: 2.1 time: 0.169862 Jun 23 12:01:21.488179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 437/966] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 12:01:21 2022] DELETE /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments/6766fc0e-23e7-4f53-838f-c005fbab80e6 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:01:21.496552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a6db83c3-a2cf-4c84-829e-332123455f95 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:21.497501 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a6db83c3-a2cf-4c84-829e-332123455f95 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:21.504187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6db83c3-a2cf-4c84-829e-332123455f95 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:21.504953 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6db83c3-a2cf-4c84-829e-332123455f95 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:21.505775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6db83c3-a2cf-4c84-829e-332123455f95 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:21.506385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6db83c3-a2cf-4c84-829e-332123455f95 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:21.540984 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a6db83c3-a2cf-4c84-829e-332123455f95 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048223 Jun 23 12:01:21.541543 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 530/967] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:01:21 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:01:22.554510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-75e7ff51-c572-44dd-8423-6f4384224c01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:22.555745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-75e7ff51-c572-44dd-8423-6f4384224c01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:22.562571 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75e7ff51-c572-44dd-8423-6f4384224c01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:22.563023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75e7ff51-c572-44dd-8423-6f4384224c01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:22.563792 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75e7ff51-c572-44dd-8423-6f4384224c01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:22.564241 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-75e7ff51-c572-44dd-8423-6f4384224c01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:22.595124 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-75e7ff51-c572-44dd-8423-6f4384224c01 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045396 Jun 23 12:01:22.595699 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 438/968] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:01:22 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 12:01:22.652876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:22.653384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:22.661443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:22.661821 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:22.662608 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:22.663475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:22.690093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:01:22.774468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3b54814a-06d3-423e-b06f-9b15b5caced7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 204 len: 0 microversion: 2.1 time: 0.125173 Jun 23 12:01:22.775052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 531/969] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:01:22 2022] DELETE /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 0 bytes in 127 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:01:22.783739 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:22.784349 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:22.790493 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:22.790941 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:22.791701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:22.792131 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:22.935402 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:22.943437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9bfbaacb-3bc3-495f-ad4a-8925b28740b7 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1680 microversion: 2.1 time: 0.164045 Jun 23 12:01:22.945049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 439/970] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:22 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1680 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:23.962612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:23.963234 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:23.970217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:23.970670 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:23.971438 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:23.971876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:24.116466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:24.124100 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2622cfcb-4d15-477f-8c52-79b53ad3c0de tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1680 microversion: 2.1 time: 0.165867 Jun 23 12:01:24.124715 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 532/971] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:23 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1680 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:25.142153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:25.142746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:25.149373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:25.149999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:25.151002 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:25.151479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:25.284296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:25.291828 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-889c7023-2fb1-4b6d-b3ba-92de401c0663 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1680 microversion: 2.1 time: 0.154039 Jun 23 12:01:25.292396 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 440/972] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:25 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1680 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:26.070442 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-7420bee7-6517-46a1-9968-9bcb0299d15a req-3e7cb8c9-1c43-4857-b4b4-89e24a31bd4b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "429b22b9-be19-4630-80e1-18b745a0eedc", "name": "network-vif-deleted", "tag": "c63ff76c-f546-4559-b427-7daf2c346e55"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:26.081410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7420bee7-6517-46a1-9968-9bcb0299d15a req-3e7cb8c9-1c43-4857-b4b4-89e24a31bd4b service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:26.081857 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7420bee7-6517-46a1-9968-9bcb0299d15a req-3e7cb8c9-1c43-4857-b4b4-89e24a31bd4b service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:26.093309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-7420bee7-6517-46a1-9968-9bcb0299d15a req-3e7cb8c9-1c43-4857-b4b4-89e24a31bd4b service nova] Creating event network-vif-deleted:c63ff76c-f546-4559-b427-7daf2c346e55 for instance 429b22b9-be19-4630-80e1-18b745a0eedc on hv-cinder-82660 Jun 23 12:01:26.098796 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-7420bee7-6517-46a1-9968-9bcb0299d15a req-3e7cb8c9-1c43-4857-b4b4-89e24a31bd4b service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032094 Jun 23 12:01:26.099401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 533/973] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:26.309439 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:26.310060 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:26.316749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:26.317204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:26.317989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:26.318428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:26.381654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:26.389895 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6d664d88-2610-4249-b26b-bb06e74de019 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1326 microversion: 2.1 time: 0.084262 Jun 23 12:01:26.390460 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 441/974] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:26 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1326 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:27.407481 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:27.408154 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:27.414787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:27.415238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:27.416008 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:27.416443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:27.451300 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:27.451885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:27.452377 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lazy-loading 'fault' on Instance uuid 429b22b9-be19-4630-80e1-18b745a0eedc {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:01:27.499218 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:27.508356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-33bef600-acde-4b74-ba7d-109ed206aea9 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 200 len: 1331 microversion: 2.1 time: 0.104883 Jun 23 12:01:27.511899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 534/975] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:27 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 1331 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:28.525465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:28.526074 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:28.533451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:28.533993 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:28.534963 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:28.535395 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:28.549866 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc HTTP/1.1 Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:01:28.551436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:01:28.553115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '429b22b9-be19-4630-80e1-18b745a0eedc'} Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:01:28.554085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:01:28.555852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:01:28.557266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:01:28.557266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-790bc0d4-3012-44fd-932d-8555c1bb2787 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 404 len: 111 microversion: 2.1 time: 0.031132 Jun 23 12:01:28.557266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 442/976] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:28 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:01:28.566167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2270dcfc-3919-45c2-b338-474782e82476 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '.version_select at 0x7f3ae60e0160>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:28.586265 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2270dcfc-3919-45c2-b338-474782e82476 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-282459633" status: 202 len: 0 microversion: 2.1 time: 0.023862 Jun 23 12:01:28.587041 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 535/977] 10.222.0.67 () {58 vars in 1217 bytes} [Thu Jun 23 12:01:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-282459633 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:01:29.265151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-80998cbd-6f07-482c-becb-7c71a8e26a22 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: .version_select at 0x7f3ae5f653a0>, body: {"keypair": {"name": "tempest-keypair-22934250", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFChf5FiCiLHbFgxzPDJbcWxUWU8se12XmLBoyRUenbh2uK4MQyw8JTpqqTiUnvz00NqqpKBvjlesa1EXf6vM25pyHB7hxWjelLLFf5t2FA2iFkgfM4OcSXmjexgbligMg=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:29.279504 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-80998cbd-6f07-482c-becb-7c71a8e26a22 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:01:29.283559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-80998cbd-6f07-482c-becb-7c71a8e26a22 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:01:29.306137 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-80998cbd-6f07-482c-becb-7c71a8e26a22 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.044935 Jun 23 12:01:29.306908 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 443/978] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 12:01:29 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:30.586482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-809730792", "imageRef": "f93e5ce9-73c4-463c-8cb8-2ccd7be0143d", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "e2860678-188a-43de-956c-7f6a2a5353f6"}], "security_groups": [{"name": "tempest-securitygroup--153195157"}], "key_name": "tempest-keypair-22934250", "user_data": "}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:30.690721 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] validate_networks() for [('e2860678-188a-43de-956c-7f6a2a5353f6', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:01:31.071388 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:01:31.071874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:01:31.072353 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:01:31.072985 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:01:31.073406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:01:31.082718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:31.083171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:31.084050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:31.084414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:31.101776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:01:31.105994 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Getting quotas for user 9cc891cc8172490394d2bfa3c8d1dcf8 and project b4f73dfee32d43b985e9192000eaed8c. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:01:31.118173 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:01:31.120444 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f93e5ce9-73c4-463c-8cb8-2ccd7be0143d',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:01:31.167671 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a3f11c9d-1a6f-4a72-9638-0010f2e1498a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.585836 Jun 23 12:01:31.168315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 536/979] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 12:01:30 2022] POST /compute/v2.1/servers => generated 401 bytes in 587 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 12:01:31.179591 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-899298a1-de1f-407a-9f01-97e0fe91963b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:31.180207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-899298a1-de1f-407a-9f01-97e0fe91963b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:31.237704 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-899298a1-de1f-407a-9f01-97e0fe91963b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:31.245440 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-899298a1-de1f-407a-9f01-97e0fe91963b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1239 microversion: 2.1 time: 0.070187 Jun 23 12:01:31.246024 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 444/980] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:31 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1239 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:32.263234 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:32.264459 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:32.272217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:32.272944 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:32.277785 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:32.278329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:32.355412 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:32.363989 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8a815891-fca5-4b0d-ba6f-a7410017ba83 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1297 microversion: 2.1 time: 0.105295 Jun 23 12:01:32.364653 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 537/981] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:32 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1297 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:33.381794 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:33.382333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:33.389882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:33.390336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:33.391303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:33.392480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:33.619570 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:33.628110 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e05b5be8-203c-468c-b128-63dd341be688 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.250255 Jun 23 12:01:33.628951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 445/982] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:33 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:33.767842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-7836b03c-ebab-466c-baa4-d83eefb926bc req-6ade31f9-0b12-4e6a-b36b-f9eb882610aa service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1", "tag": "23b9efef-6889-4666-ac0e-537e6c48240c"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:33.776731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7836b03c-ebab-466c-baa4-d83eefb926bc req-6ade31f9-0b12-4e6a-b36b-f9eb882610aa service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:33.777514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-7836b03c-ebab-466c-baa4-d83eefb926bc req-6ade31f9-0b12-4e6a-b36b-f9eb882610aa service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:33.796232 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-7836b03c-ebab-466c-baa4-d83eefb926bc req-6ade31f9-0b12-4e6a-b36b-f9eb882610aa service nova] Creating event network-changed:23b9efef-6889-4666-ac0e-537e6c48240c for instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 on hv-cinder-82660 Jun 23 12:01:33.801570 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-7836b03c-ebab-466c-baa4-d83eefb926bc req-6ade31f9-0b12-4e6a-b36b-f9eb882610aa service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037851 Jun 23 12:01:33.802238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 538/983] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:34.645681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:34.646357 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:34.652964 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:34.653538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:34.654430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:34.654946 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:34.786635 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:34.794283 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0eeaea3b-48a8-46a3-9169-95d029af3724 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.152943 Jun 23 12:01:34.794852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 446/984] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:34 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:35.191162 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ddf91ff5-de64-434d-a210-903fbf69b5fa tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:35.191748 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ddf91ff5-de64-434d-a210-903fbf69b5fa tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:35.198002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddf91ff5-de64-434d-a210-903fbf69b5fa tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:35.198454 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddf91ff5-de64-434d-a210-903fbf69b5fa tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:35.199218 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddf91ff5-de64-434d-a210-903fbf69b5fa tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:35.199658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddf91ff5-de64-434d-a210-903fbf69b5fa tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:35.222790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ddf91ff5-de64-434d-a210-903fbf69b5fa tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/ips" status: 200 len: 152 microversion: 2.20 time: 0.036913 Jun 23 12:01:35.223357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 539/985] 10.222.0.67 () {60 vars in 1288 bytes} [Thu Jun 23 12:01:35 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/ips => generated 152 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 12:01:35.811346 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:35.811960 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:35.818579 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:35.819037 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:35.819791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:35.820222 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:35.954387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:35.961816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a5a23162-4573-4873-8273-78ddf18f7b21 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.154409 Jun 23 12:01:35.962377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 447/986] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:35 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:36.978897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:36.979518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:36.981968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=59,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:36.987282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:36.987739 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:36.988506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:36.988969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:37.121463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:37.129033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-261bce3a-40cc-4c7d-bb8a-0068ba8f7f9f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.154123 Jun 23 12:01:37.129611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 540/987] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:36 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:38.142951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:38.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:38.145381 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:38.146002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:38.150083 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:38.150534 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:38.151302 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:38.151740 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:38.152656 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:38.153161 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:38.153896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:38.154328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:38.168413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:38.176860 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lazy-loading 'flavor' on Instance uuid bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:01:38.287838 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:38.295314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-95e987d7-e60d-475e-b6a6-920b611dd455 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.153710 Jun 23 12:01:38.295871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 541/988] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:38 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:01:38.449433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ec9432c3-81c3-47be-b0d2-9332e5d5ac0d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/action" status: 202 len: 0 microversion: 2.20 time: 0.310544 Jun 23 12:01:38.450047 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 448/989] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 23 12:01:38 2022] POST /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/action => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:01:38.458217 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:38.458829 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:38.464899 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:38.465346 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:38.466093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:38.466517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:38.597509 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:38.605969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:38.607490 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:38.608660 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7e010122-9b78-4a3e-b97c-34c5929dff65 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.154418 Jun 23 12:01:38.609238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 542/990] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:38 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:39.314019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:39.314726 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:39.321642 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:39.322096 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:39.322859 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:39.323298 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:39.452359 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:39.460224 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-81f49c6f-54ac-4c71-a950-11c43b9bea2a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.150970 Jun 23 12:01:39.460820 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 449/991] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:39 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:39.627878 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:39.628450 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:39.634882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:39.635332 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:39.636119 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:39.636551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:39.765593 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:39.774167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:39.775668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:39.776866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-dcb85089-f812-470f-837e-6dae0ae61b1e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.153066 Jun 23 12:01:39.777423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 543/992] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:39 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:40.476978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:40.477723 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:40.484408 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:40.484898 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:40.485675 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:40.486145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:40.684144 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:40.691694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0a4d7c1b-808e-4a42-a1fc-6f942e31d680 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.218595 Jun 23 12:01:40.692265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 450/993] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:40 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:40.795614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:40.796291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:40.803627 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:40.804079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:40.804884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:40.805323 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:40.823636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:40.938369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:40.946432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:40.947951 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:40.949804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-87697599-4747-4b60-bd13-d620fe986a93 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.157608 Jun 23 12:01:40.949804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 544/994] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:40 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:41.708652 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:41.709413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:41.711410 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=6 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:41.712509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:41.718586 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:41.719035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:41.719810 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:41.720297 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:41.967491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:41.968213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:41.970230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:41.971031 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=6 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:01:41.978813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:41.979293 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:41.980517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:41.980979 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:42.128734 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:42.137451 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:42.138976 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:42.139104 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:42.140489 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-982356a1-b0c2-48d7-9076-39c90b8feeba tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.176829 Jun 23 12:01:42.141093 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 545/995] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:41 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:01:42.151024 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-74e790c6-ec82-4209-aca3-9fa60834ab42 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.443390 Jun 23 12:01:42.151024 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 451/996] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:41 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 445 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:43.158654 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:43.159210 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:43.165110 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:43.165722 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:43.166002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:43.166455 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:43.167261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:43.167758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:43.172217 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:43.172709 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:43.173471 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:43.173903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:43.309914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:43.314373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:43.319235 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:43.320767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:43.321941 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bb25486a-70ee-424d-8d1b-8fa6683caef9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.167292 Jun 23 12:01:43.322537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 546/997] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:43 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:43.323674 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-38636e39-a8b0-452b-98fc-ed5b54cc9b4c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.162297 Jun 23 12:01:43.324461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 452/998] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:43 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:43.381897 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-4a1ea5de-0b3f-411c-9bbd-928024035510 req-7aadba18-6492-40f9-9104-f24502a8e24f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1", "name": "network-vif-plugged", "status": "completed", "tag": "23b9efef-6889-4666-ac0e-537e6c48240c"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:43.389959 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-4a1ea5de-0b3f-411c-9bbd-928024035510 req-7aadba18-6492-40f9-9104-f24502a8e24f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:43.390404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-4a1ea5de-0b3f-411c-9bbd-928024035510 req-7aadba18-6492-40f9-9104-f24502a8e24f service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:43.401943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-4a1ea5de-0b3f-411c-9bbd-928024035510 req-7aadba18-6492-40f9-9104-f24502a8e24f service nova] Creating event network-vif-plugged:23b9efef-6889-4666-ac0e-537e6c48240c for instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 on hv-cinder-82660 Jun 23 12:01:43.406920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-4a1ea5de-0b3f-411c-9bbd-928024035510 req-7aadba18-6492-40f9-9104-f24502a8e24f service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029390 Jun 23 12:01:43.407572 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 547/999] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:44.339792 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:44.340429 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:44.341549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:44.342256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:44.347040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:44.347526 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:44.348303 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:44.348762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:44.348971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:44.349758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:44.350986 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:44.351436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:44.491746 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:44.495171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:44.499874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:44.501536 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:44.502681 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-68d4fe45-42ff-4d1e-bfe0-b99a40af51af tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.165861 Jun 23 12:01:44.502847 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-54219026-fbcc-4ceb-a098-452cbbe41d78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.167257 Jun 23 12:01:44.503261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 548/1000] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:44 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:01:44.503518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 453/1001] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:44 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:45.519986 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:45.520590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:45.522521 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:45.523141 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:45.527169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:45.527616 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:45.528381 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:45.528833 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:45.529703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:45.530162 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:45.530931 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:45.531370 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:45.666661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:45.669322 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:45.675128 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:45.676718 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:45.676992 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9c3c8f2b-50df-46f6-8823-438629f207ee tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.161324 Jun 23 12:01:45.677570 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 549/1002] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:45 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:45.677844 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c91c9bae-0e69-4ec2-8b9b-bb685fda85e5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.159665 Jun 23 12:01:45.678654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 454/1003] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:45 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:01:46.693979 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:46.694681 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:46.695153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:46.695801 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:46.701400 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:46.701874 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:46.702220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:46.702612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:46.702732 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:46.703047 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:46.703432 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:46.703923 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:46.835862 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:46.838104 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:46.843636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-700dd026-dd9f-4bbc-a47f-8ad4d630a764 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1364 microversion: 2.1 time: 0.153534 Jun 23 12:01:46.844304 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 550/1004] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:46 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:46.846265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:46.848549 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:46.849803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8e5a29be-c4a4-43cb-b9c4-3c7e2bb84449 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.158499 Jun 23 12:01:46.850321 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 455/1005] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:46 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:01:47.867316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:47.868122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:47.869857 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:47.871329 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:47.874859 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:47.875259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:47.876223 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:47.876661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:47.880899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:47.881756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:47.883046 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:47.884026 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:48.030458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:48.034098 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:48.038644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-12407a97-93b9-4a54-9fa9-5e1fa2719be6 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1554 microversion: 2.1 time: 0.177422 Jun 23 12:01:48.039220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 551/1006] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:01:47 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1554 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:01:48.042914 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:48.044492 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:48.045695 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c39c577d-4e7e-4e26-8a5f-7d001b12c070 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.182173 Jun 23 12:01:48.046246 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 456/1007] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:47 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:48.054805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-25e398cd-8a33-4aa0-8f89-1ccb1a661a7a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:48.055291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-25e398cd-8a33-4aa0-8f89-1ccb1a661a7a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:48.061324 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e398cd-8a33-4aa0-8f89-1ccb1a661a7a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:48.061787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e398cd-8a33-4aa0-8f89-1ccb1a661a7a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:48.062536 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e398cd-8a33-4aa0-8f89-1ccb1a661a7a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:48.062969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-25e398cd-8a33-4aa0-8f89-1ccb1a661a7a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:48.138721 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-25e398cd-8a33-4aa0-8f89-1ccb1a661a7a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.087546 Jun 23 12:01:48.139319 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 552/1008] 10.222.0.67 () {58 vars in 1274 bytes} [Thu Jun 23 12:01:48 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-interface => generated 284 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:49.063669 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:49.064304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:49.074115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:49.075486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:49.076335 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:49.077063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:49.226986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:49.235805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:49.237374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:49.238643 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-23ce5801-66f8-4606-89ed-6495ab825049 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.179101 Jun 23 12:01:49.239240 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 457/1009] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:49 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:49.320227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-21d3d4fe-9f80-4bd1-a787-9cb5ca0a306c req-03eba398-d8e0-4971-8fc9-9720e26171a8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1", "tag": "23b9efef-6889-4666-ac0e-537e6c48240c"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:49.328329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-21d3d4fe-9f80-4bd1-a787-9cb5ca0a306c req-03eba398-d8e0-4971-8fc9-9720e26171a8 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:49.328802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-21d3d4fe-9f80-4bd1-a787-9cb5ca0a306c req-03eba398-d8e0-4971-8fc9-9720e26171a8 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:49.340441 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-21d3d4fe-9f80-4bd1-a787-9cb5ca0a306c req-03eba398-d8e0-4971-8fc9-9720e26171a8 service nova] Creating event network-changed:23b9efef-6889-4666-ac0e-537e6c48240c for instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 on hv-cinder-82660 Jun 23 12:01:49.345529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-21d3d4fe-9f80-4bd1-a787-9cb5ca0a306c req-03eba398-d8e0-4971-8fc9-9720e26171a8 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029486 Jun 23 12:01:49.346379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 553/1010] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:01:50.258657 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:50.259274 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:50.266298 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:50.266846 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:50.267722 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:50.268234 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:50.423359 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:50.432502 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:50.434042 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:50.435216 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-241bf760-6c74-4d15-b6cc-d5318470b16f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.181414 Jun 23 12:01:50.435782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 458/1011] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:50 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:51.454385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:51.455088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:51.461890 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:51.462341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:51.463111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:51.463549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:51.640889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:51.649903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:51.651446 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:51.652642 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-05729f4b-8c18-4818-ba53-f36a0a63e395 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.202982 Jun 23 12:01:51.653227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 554/1012] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:51 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:52.672004 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:52.672617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:52.680770 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:52.681220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:52.681986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:52.682447 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:52.836962 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:52.845909 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:52.847486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:52.848752 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7095796c-2690-44b3-9177-1c3f2425b451 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.181361 Jun 23 12:01:52.849928 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 459/1013] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:52 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:53.868290 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:53.869730 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:53.878662 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:53.879481 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:53.880530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:53.881802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:54.022320 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:54.030375 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:54.031875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:54.033065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9f1d0a75-e9b9-4535-ad87-fccf4dc38e7d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.169569 Jun 23 12:01:54.033626 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 555/1014] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:53 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:55.051828 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:55.052450 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:55.059611 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:55.060065 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:55.060897 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:55.061337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:55.197506 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:55.205553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:55.207178 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:55.208495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ac23fb51-969d-44e3-828d-2bc19798229b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.160961 Jun 23 12:01:55.209758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 460/1015] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:55 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:56.227901 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:56.228521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:56.235192 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:56.235644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:56.238595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:56.238595 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:56.368030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:56.375832 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:56.377365 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:56.378514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1f8cba91-5d50-464c-9e17-99fa3ee750d5 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1746 microversion: 2.20 time: 0.155203 Jun 23 12:01:56.379066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 556/1016] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:56 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:57.396193 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:57.396916 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:57.403823 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:57.404273 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:57.405084 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:57.405525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:57.543706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:57.552334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:57.554043 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:57.555277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fca831c3-e3c2-44f6-954d-2720a84dd082 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1746 microversion: 2.20 time: 0.163105 Jun 23 12:01:57.555909 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 461/1017] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:57 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1746 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:58.573459 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:58.574529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:58.581476 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:58.582005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:58.582867 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:58.583294 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:58.717646 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:58.728092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:58.730314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:58.732034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0b690ed2-060e-4575-ae9b-771b423a9b82 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.162260 Jun 23 12:01:58.732808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 557/1018] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:58 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:01:59.491807 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-c064332a-fd06-4179-afbc-531761273c76 req-f36e5cd3-c85e-4bb2-8e46-1b7d35d04d88 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3c7247-2686-47a7-96dc-7ffbbe7e7c62", "name": "network-vif-plugged", "status": "completed", "tag": "b3a6b734-e0ed-4bdf-9b35-b9b65ed45592"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:01:59.507086 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c064332a-fd06-4179-afbc-531761273c76 req-f36e5cd3-c85e-4bb2-8e46-1b7d35d04d88 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:59.508094 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c064332a-fd06-4179-afbc-531761273c76 req-f36e5cd3-c85e-4bb2-8e46-1b7d35d04d88 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:59.525375 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-c064332a-fd06-4179-afbc-531761273c76 req-f36e5cd3-c85e-4bb2-8e46-1b7d35d04d88 service nova] Creating event network-vif-plugged:b3a6b734-e0ed-4bdf-9b35-b9b65ed45592 for instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 on hv-cinder-82660 Jun 23 12:01:59.531257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-c064332a-fd06-4179-afbc-531761273c76 req-f36e5cd3-c85e-4bb2-8e46-1b7d35d04d88 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044003 Jun 23 12:01:59.532861 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 462/1019] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:01:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:01:59.751364 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:01:59.752316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:01:59.759804 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:59.760037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:59.760891 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:01:59.761430 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:01:59.936251 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:59.946066 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:59.948464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:01:59.949952 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7a053eb7-2e4c-4c6b-9a4f-061b01f14062 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.202491 Jun 23 12:01:59.961993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 558/1020] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:01:59 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:00.969341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:00.970095 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:00.980553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:00.981017 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:00.981813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:00.982269 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:01.188048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:01.196057 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:01.200314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:01.203148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:01.204577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e7158bf5-7905-4154-aac1-3d2266b40f7e tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.240351 Jun 23 12:02:01.205332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 463/1021] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:00 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:02.223328 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:02.225164 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:02.232521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:02.233586 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:02.234702 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:02.235459 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:02.398323 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:02.408723 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:02.411917 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:02.420346 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c0e754b7-e79b-4820-bb34-fd997ca8a871 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.200477 Jun 23 12:02:02.432204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 559/1022] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:02 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:03.440005 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:03.441523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:03.453022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:03.453984 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:03.455475 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:03.456118 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:03.676355 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:03.699292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:03.700948 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:03.702153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-375b18c2-3a37-4a38-9a43-42534b1d6f78 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.266652 Jun 23 12:02:03.712879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 464/1023] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:03 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:03.808337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6c9f8152-1763-42f3-970b-bdd6f3ceeb87 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:03.809669 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6c9f8152-1763-42f3-970b-bdd6f3ceeb87 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:03.816716 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c9f8152-1763-42f3-970b-bdd6f3ceeb87 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:03.817169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c9f8152-1763-42f3-970b-bdd6f3ceeb87 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:03.818711 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c9f8152-1763-42f3-970b-bdd6f3ceeb87 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:03.819397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6c9f8152-1763-42f3-970b-bdd6f3ceeb87 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:03.846259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6c9f8152-1763-42f3-970b-bdd6f3ceeb87 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/ips" status: 200 len: 144 microversion: 2.1 time: 0.041747 Jun 23 12:02:03.846847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 560/1024] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 12:02:03 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/ips => generated 144 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:02:04.730701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:04.731921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:04.738745 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:04.739186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:04.740742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:04.741334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:04.905810 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:04.915148 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:04.917115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:04.919737 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-65808491-4bb6-4a5b-972b-ecab48cff272 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.193645 Jun 23 12:02:04.930830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 465/1025] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:04 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:05.277238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-68fa2577-b48a-41c4-974e-9a2f739112e8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "81a332e6-14d1-4394-8657-cbb66fb124a2"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:05.278903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-68fa2577-b48a-41c4-974e-9a2f739112e8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:05.285778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68fa2577-b48a-41c4-974e-9a2f739112e8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:05.286506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68fa2577-b48a-41c4-974e-9a2f739112e8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:05.287466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68fa2577-b48a-41c4-974e-9a2f739112e8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:05.288069 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-68fa2577-b48a-41c4-974e-9a2f739112e8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:05.591530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:05.608597 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-68fa2577-b48a-41c4-974e-9a2f739112e8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.335001 Jun 23 12:02:05.617980 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 561/1026] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 12:02:05 2022] POST /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments => generated 194 bytes in 345 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:05.944869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:05.946249 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:05.954783 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:05.955337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:05.956186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:05.956721 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:06.115586 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:06.132785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:06.143509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:06.145841 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-09c72cb6-131e-44bf-a29b-5fe2fcee01ed tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.212018 Jun 23 12:02:06.147985 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 466/1027] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:05 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:07.168376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:07.169117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:07.171735 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=44 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:07.180100 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:07.180556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:07.181421 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:07.181863 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:07.348221 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:07.356361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:07.358041 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:07.359215 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-855f8dbc-31aa-4163-b322-1f2e18d5dfb8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.195165 Jun 23 12:02:07.359774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 562/1028] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:07 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:08.377441 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:08.378041 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:08.385155 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:08.385600 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:08.386358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:08.386788 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:08.521165 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:08.529774 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:08.531264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:08.532468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8d15b11d-d16b-4b21-a3c6-5f601f94f271 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1741 microversion: 2.20 time: 0.158931 Jun 23 12:02:08.538731 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 467/1029] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:08 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1741 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:09.551222 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:09.551826 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:09.558351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:09.558799 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:09.559558 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:09.559988 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:09.691315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:09.699367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:09.700911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:09.702076 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8b23adc1-1113-4d76-abbb-f2a2110a537f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1723 microversion: 2.20 time: 0.155103 Jun 23 12:02:09.702639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 563/1030] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:09 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:10.721225 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:10.721836 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:10.729125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:10.729577 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:10.730350 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:10.730999 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:10.864732 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:10.873151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:10.874650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:10.875804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f0e49376-260a-416c-a98c-6f884e855d17 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1723 microversion: 2.20 time: 0.158785 Jun 23 12:02:10.876365 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 468/1031] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:10 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1723 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:02:11.449517 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-ac03d6a0-22c3-40aa-b9c8-4c5a8b655762 req-a68a6831-62c0-4181-b817-827d472ae5c1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3c7247-2686-47a7-96dc-7ffbbe7e7c62", "name": "network-vif-unplugged", "status": "completed", "tag": "b3a6b734-e0ed-4bdf-9b35-b9b65ed45592"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:11.459379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ac03d6a0-22c3-40aa-b9c8-4c5a8b655762 req-a68a6831-62c0-4181-b817-827d472ae5c1 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:11.459822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ac03d6a0-22c3-40aa-b9c8-4c5a8b655762 req-a68a6831-62c0-4181-b817-827d472ae5c1 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:11.471771 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-ac03d6a0-22c3-40aa-b9c8-4c5a8b655762 req-a68a6831-62c0-4181-b817-827d472ae5c1 service nova] Creating event network-vif-unplugged:b3a6b734-e0ed-4bdf-9b35-b9b65ed45592 for instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 on hv-cinder-82660 Jun 23 12:02:11.477489 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-ac03d6a0-22c3-40aa-b9c8-4c5a8b655762 req-a68a6831-62c0-4181-b817-827d472ae5c1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.031709 Jun 23 12:02:11.478129 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 564/1032] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:02:11 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:11.894055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:11.894758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:11.897683 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=36 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:11.903450 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:11.903906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:11.904685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:11.905168 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.054893 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:12.066854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:12.070082 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:12.072093 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-51bd7ee7-6de4-40b6-acfb-091148350e79 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1666 microversion: 2.20 time: 0.181688 Jun 23 12:02:12.073205 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 469/1033] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:11 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1666 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:12.104183 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-52c2f368-a8e6-4be9-88f1-c2d29dc9dc6d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b74d22da-1b90-4f67-9ece-13269787b6a7"}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:12.105472 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-52c2f368-a8e6-4be9-88f1-c2d29dc9dc6d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:12.115718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52c2f368-a8e6-4be9-88f1-c2d29dc9dc6d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.116491 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52c2f368-a8e6-4be9-88f1-c2d29dc9dc6d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.117488 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52c2f368-a8e6-4be9-88f1-c2d29dc9dc6d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.117973 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52c2f368-a8e6-4be9-88f1-c2d29dc9dc6d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.435789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-52c2f368-a8e6-4be9-88f1-c2d29dc9dc6d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.339823 Jun 23 12:02:12.436397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 565/1034] 10.222.0.67 () {62 vars in 1363 bytes} [Thu Jun 23 12:02:12 2022] POST /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-volume_attachments => generated 188 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 23 12:02:12.551480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-abb7aeaa-ee91-443f-a692-afa3a0a66607 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:12.551974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-abb7aeaa-ee91-443f-a692-afa3a0a66607 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:12.558432 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-abb7aeaa-ee91-443f-a692-afa3a0a66607 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.558879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-abb7aeaa-ee91-443f-a692-afa3a0a66607 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.559632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-abb7aeaa-ee91-443f-a692-afa3a0a66607 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.560061 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-abb7aeaa-ee91-443f-a692-afa3a0a66607 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.808559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-abb7aeaa-ee91-443f-a692-afa3a0a66607 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-volume_attachments/b74d22da-1b90-4f67-9ece-13269787b6a7" status: 202 len: 0 microversion: 2.20 time: 0.261194 Jun 23 12:02:12.809191 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 470/1035] 10.222.0.67 () {60 vars in 1456 bytes} [Thu Jun 23 12:02:12 2022] DELETE /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-volume_attachments/b74d22da-1b90-4f67-9ece-13269787b6a7 => generated 0 bytes in 263 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:02:12.877755 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-83f8ce82-b841-4ce1-835d-11f9251d7369 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:12.878358 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-83f8ce82-b841-4ce1-835d-11f9251d7369 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:12.884945 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f8ce82-b841-4ce1-835d-11f9251d7369 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.885416 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f8ce82-b841-4ce1-835d-11f9251d7369 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.886167 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f8ce82-b841-4ce1-835d-11f9251d7369 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.886714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-83f8ce82-b841-4ce1-835d-11f9251d7369 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.968273 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-83f8ce82-b841-4ce1-835d-11f9251d7369 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "POST /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/action" status: 202 len: 0 microversion: 2.20 time: 0.094377 Jun 23 12:02:12.968914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 566/1036] 10.222.0.67 () {62 vars in 1318 bytes} [Thu Jun 23 12:02:12 2022] POST /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/action => generated 0 bytes in 96 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:02:12.977619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:12.978244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:12.985528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.986214 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:12.987007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:12.987446 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:13.164456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:13.175517 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:13.177407 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:13.178708 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-89786ce7-edc5-48bc-93f1-cf888113bcc4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1674 microversion: 2.20 time: 0.205608 Jun 23 12:02:13.179265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 471/1037] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:12 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1674 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:13.189464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-153c04b3-7688-400b-92a7-88f57b15419f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:13.189464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-153c04b3-7688-400b-92a7-88f57b15419f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:13.189464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-153c04b3-7688-400b-92a7-88f57b15419f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:13.189464 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-153c04b3-7688-400b-92a7-88f57b15419f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:13.189869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-153c04b3-7688-400b-92a7-88f57b15419f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:13.189869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-153c04b3-7688-400b-92a7-88f57b15419f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:13.220418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-153c04b3-7688-400b-92a7-88f57b15419f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044230 Jun 23 12:02:13.221015 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 567/1038] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:13 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:13.237140 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-903cc942-aefa-41f1-88e6-2d05f79dd07f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:13.237645 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-903cc942-aefa-41f1-88e6-2d05f79dd07f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:13.244127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-903cc942-aefa-41f1-88e6-2d05f79dd07f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:13.244610 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-903cc942-aefa-41f1-88e6-2d05f79dd07f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:13.245581 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-903cc942-aefa-41f1-88e6-2d05f79dd07f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:13.246026 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-903cc942-aefa-41f1-88e6-2d05f79dd07f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:13.276658 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-903cc942-aefa-41f1-88e6-2d05f79dd07f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/81a332e6-14d1-4394-8657-cbb66fb124a2" status: 200 len: 194 microversion: 2.1 time: 0.044008 Jun 23 12:02:13.278315 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 472/1039] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Jun 23 12:02:13 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/81a332e6-14d1-4394-8657-cbb66fb124a2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:14.197831 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:14.198453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:14.205419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:14.206025 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:14.206871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:14.207314 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:14.349130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:14.359112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:14.360666 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:14.362100 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2384d9e7-992e-427f-bdcf-312d80da9717 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.169057 Jun 23 12:02:14.362844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 568/1040] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:14 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:14.629326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6a2abee8-bc63-495d-a289-f5d7f4dc1e97 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4ff42a3e-25d6-4035-aeb5-daa5387d4424"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:14.630445 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6a2abee8-bc63-495d-a289-f5d7f4dc1e97 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:14.637637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6a2abee8-bc63-495d-a289-f5d7f4dc1e97 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:14.638087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6a2abee8-bc63-495d-a289-f5d7f4dc1e97 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:14.638934 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6a2abee8-bc63-495d-a289-f5d7f4dc1e97 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:14.639373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6a2abee8-bc63-495d-a289-f5d7f4dc1e97 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:14.907240 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6a2abee8-bc63-495d-a289-f5d7f4dc1e97 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "POST /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281928 Jun 23 12:02:14.922006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 473/1041] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 12:02:14 2022] POST /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:02:15.382181 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:15.383430 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:15.392020 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:15.392660 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:15.393653 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:15.394255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:15.601812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:15.611039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:15.613359 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:15.614565 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3704f75c-6384-4666-aafd-462294645e64 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.236990 Jun 23 12:02:15.621070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 569/1042] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:15 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:16.637172 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:16.645523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:16.646694 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:16.647229 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:16.648089 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:16.648603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:16.791921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:16.800793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:16.802476 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:16.804320 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-25815738-6798-4618-a1fb-96109e091f96 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.174198 Jun 23 12:02:16.805046 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 474/1043] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:16 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:17.823860 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:17.824642 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:17.830922 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:17.831367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:17.832132 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:17.832555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:17.970027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:17.979164 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:17.980856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:17.982264 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-db4c5864-3823-4948-b2fb-187ec8739620 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.162459 Jun 23 12:02:17.982829 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 570/1044] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:17 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:19.002661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:19.003280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:19.011451 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:19.011910 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:19.012892 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:19.013337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:19.154901 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:19.163669 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:19.165218 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:19.166448 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-39ebc0cf-eece-4986-a719-4fcbeee9504d tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.167831 Jun 23 12:02:19.167016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 475/1045] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:18 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:20.186971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:20.187809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:20.195289 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:20.196033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:20.196918 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:20.197356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:20.365401 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:20.374624 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:20.376564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:20.377839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-051b0847-2317-4d23-b4c6-5999eb215ace tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.194897 Jun 23 12:02:20.378476 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 571/1046] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:20 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:21.396279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:21.397090 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:21.405139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:21.405642 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:21.406436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:21.406879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:21.545362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:21.547676 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=3,nova_cell1:UPDATE=6 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:21.556351 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:21.557908 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:21.559138 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9d32fce2-6f99-477e-bfe6-4f198592ef5f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.167000 Jun 23 12:02:21.559712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 476/1047] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:21 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:02:22.577333 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:22.577924 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:22.584830 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:22.585948 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:22.586704 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:22.587136 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:22.745713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:22.754670 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:22.756604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:22.758076 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f85f7d59-5ada-4971-bfc8-46d8a0ed65c9 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.184626 Jun 23 12:02:22.759171 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 572/1048] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:22 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:23.776800 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:23.777412 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:23.784856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:23.785309 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:23.786074 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:23.786511 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:23.919341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:23.927813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:23.929367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:23.931045 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e060b492-2a91-451e-9791-1fc1dca0aec6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.158723 Jun 23 12:02:23.931640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 477/1049] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:23 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:24.948952 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:24.949561 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:24.956111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:24.956555 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:24.957344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:24.957778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:25.090151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:25.098145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:25.099656 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:25.100847 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f9fb9b0c-8c2c-4731-bf8c-ab820cd5238b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.156271 Jun 23 12:02:25.101412 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 573/1050] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:24 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:26.119008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:26.119618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:26.126230 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:26.126686 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:26.127452 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:26.127892 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:26.260263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:26.268579 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:26.270100 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:26.271256 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-80b783a2-201b-4792-9960-ad7ff944acf6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.156252 Jun 23 12:02:26.271803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 478/1051] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:26 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:27.289840 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:27.290476 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:27.297111 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.297567 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:27.298329 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.298762 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:27.432968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:27.442067 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:27.443707 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:27.444958 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fc147751-086a-4c40-b623-b576e16709a6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.158947 Jun 23 12:02:27.446428 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 574/1052] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:27 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:27.744579 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fd948e84-b6f9-49a3-a752-9a3bb97969af tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:27.745806 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fd948e84-b6f9-49a3-a752-9a3bb97969af tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:27.753316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd948e84-b6f9-49a3-a752-9a3bb97969af tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.753776 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd948e84-b6f9-49a3-a752-9a3bb97969af tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:27.754553 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd948e84-b6f9-49a3-a752-9a3bb97969af tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.755020 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd948e84-b6f9-49a3-a752-9a3bb97969af tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:27.786288 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fd948e84-b6f9-49a3-a752-9a3bb97969af tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.046868 Jun 23 12:02:27.786852 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 479/1053] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:27 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments => generated 371 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:27.936486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-03c4e0cf-c4ca-4750-b3ac-2bc4effc7430 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:27.936997 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-03c4e0cf-c4ca-4750-b3ac-2bc4effc7430 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:27.943145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-03c4e0cf-c4ca-4750-b3ac-2bc4effc7430 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.943678 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-03c4e0cf-c4ca-4750-b3ac-2bc4effc7430 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:27.944623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-03c4e0cf-c4ca-4750-b3ac-2bc4effc7430 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.945126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-03c4e0cf-c4ca-4750-b3ac-2bc4effc7430 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:27.961957 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:27.977779 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-03c4e0cf-c4ca-4750-b3ac-2bc4effc7430 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/81a332e6-14d1-4394-8657-cbb66fb124a2" status: 200 len: 194 microversion: 2.1 time: 0.045216 Jun 23 12:02:27.978402 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 575/1054] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Jun 23 12:02:27 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/81a332e6-14d1-4394-8657-cbb66fb124a2 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:27.988620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:27.989437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:27.996478 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.997019 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:27.997877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:27.998358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:28.077910 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lazy-loading 'services' on Instance uuid 55cdb509-57bb-458f-969a-99f8da10eea5 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:02:28.151561 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f87553f8-a313-4a28-9f26-ba1bd239695b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/81a332e6-14d1-4394-8657-cbb66fb124a2" status: 202 len: 0 microversion: 2.1 time: 0.167223 Jun 23 12:02:28.152175 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 480/1055] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 12:02:27 2022] DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/81a332e6-14d1-4394-8657-cbb66fb124a2 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:02:28.463446 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:28.464062 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:28.470645 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:28.471097 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:28.471869 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:28.472303 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:28.605027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:28.613006 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:28.614516 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:28.615672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6593dab1-b56b-4d3f-95b1-7e652fa99852 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.156146 Jun 23 12:02:28.616230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 576/1056] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:28 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:29.274307 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-128a03f0-37bd-44a8-b9ca-98ab651d7ebb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:29.274895 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-128a03f0-37bd-44a8-b9ca-98ab651d7ebb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:29.281176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-128a03f0-37bd-44a8-b9ca-98ab651d7ebb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:29.281640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-128a03f0-37bd-44a8-b9ca-98ab651d7ebb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:29.282409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-128a03f0-37bd-44a8-b9ca-98ab651d7ebb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:29.282846 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-128a03f0-37bd-44a8-b9ca-98ab651d7ebb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:29.311330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-128a03f0-37bd-44a8-b9ca-98ab651d7ebb tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/4ff42a3e-25d6-4035-aeb5-daa5387d4424" status: 200 len: 194 microversion: 2.1 time: 0.042453 Jun 23 12:02:29.311920 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 481/1057] 10.222.0.67 () {58 vars in 1412 bytes} [Thu Jun 23 12:02:29 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/4ff42a3e-25d6-4035-aeb5-daa5387d4424 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:29.322263 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:29.322758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:29.328747 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:29.329203 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:29.329964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:29.330390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:29.409090 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lazy-loading 'services' on Instance uuid 55cdb509-57bb-458f-969a-99f8da10eea5 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:02:29.482010 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4b84004a-0537-4a35-8ba2-b5d20602153f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/4ff42a3e-25d6-4035-aeb5-daa5387d4424" status: 202 len: 0 microversion: 2.1 time: 0.164021 Jun 23 12:02:29.482838 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 577/1058] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 12:02:29 2022] DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments/4ff42a3e-25d6-4035-aeb5-daa5387d4424 => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:02:29.579406 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-fbb05446-17f2-4041-815d-286290afafed req-dc71cffa-fec4-494c-b3b9-bba1cae19c57 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3c7247-2686-47a7-96dc-7ffbbe7e7c62", "name": "network-vif-plugged", "status": "completed", "tag": "b3a6b734-e0ed-4bdf-9b35-b9b65ed45592"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:29.588213 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-fbb05446-17f2-4041-815d-286290afafed req-dc71cffa-fec4-494c-b3b9-bba1cae19c57 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:29.588661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-fbb05446-17f2-4041-815d-286290afafed req-dc71cffa-fec4-494c-b3b9-bba1cae19c57 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:29.600614 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-fbb05446-17f2-4041-815d-286290afafed req-dc71cffa-fec4-494c-b3b9-bba1cae19c57 service nova] Creating event network-vif-plugged:b3a6b734-e0ed-4bdf-9b35-b9b65ed45592 for instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 on hv-cinder-82660 Jun 23 12:02:29.605664 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-fbb05446-17f2-4041-815d-286290afafed req-dc71cffa-fec4-494c-b3b9-bba1cae19c57 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029980 Jun 23 12:02:29.606256 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 482/1059] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:02:29 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:29.634767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:29.635463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:29.641805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:29.642270 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:29.642998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:29.643426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:29.777334 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:29.785295 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:29.786808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:29.787991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-95686bef-be2f-4b87-a44a-f0e0c5b3ae3c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.158311 Jun 23 12:02:29.788541 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 578/1060] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:29 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:30.757121 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:30.758295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:30.764938 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:30.765384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:30.766139 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:30.766569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:30.788934 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lazy-loading 'flavor' on Instance uuid 9442b025-7b22-40c8-8f76-3a3379bf8e83 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:02:30.806406 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:30.807047 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:30.814419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:30.814866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:30.815617 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:30.816043 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:30.860510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-00a54041-0843-4f3f-9ab4-8cee8ebd112c tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "POST /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83/action" status: 202 len: 0 microversion: 2.1 time: 0.107429 Jun 23 12:02:30.861243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 483/1061] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 12:02:30 2022] POST /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83/action => generated 0 bytes in 109 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:02:30.869566 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:30.870259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:30.876397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:30.876875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:30.877637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:30.878070 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:30.953362 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:30.962332 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:30.963848 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:30.965046 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ddb5f464-59c5-4c8c-8fb4-70550b5d83e3 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.162576 Jun 23 12:02:30.965604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 579/1062] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:30 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:02:31.021192 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:31.028781 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e022f3f5-56be-49c0-afb4-b65438541812 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.163180 Jun 23 12:02:31.029358 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 484/1063] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:30 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:02:31.983956 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:31.985229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:31.993094 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:31.993547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:31.994541 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:31.994972 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:32.048480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:32.049335 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:32.056896 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:32.057438 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:32.058206 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:32.058637 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:32.131562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:32.139882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:32.142691 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:32.143234 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-11b6da0d-0fa1-4eac-b92d-951cd3201ad4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.162846 Jun 23 12:02:32.144169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 580/1064] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:31 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:32.198832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:32.206368 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-de519b9f-85ba-46c0-9d6a-2ec75e457ab3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.163292 Jun 23 12:02:32.206930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 485/1065] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:32 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:02:32.972148 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c4e360a4-9c10-4e63-90b5-c5cadc222582 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:32.972636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c4e360a4-9c10-4e63-90b5-c5cadc222582 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:32.980228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4e360a4-9c10-4e63-90b5-c5cadc222582 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:32.981040 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4e360a4-9c10-4e63-90b5-c5cadc222582 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:32.982423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4e360a4-9c10-4e63-90b5-c5cadc222582 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:32.982889 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c4e360a4-9c10-4e63-90b5-c5cadc222582 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.007718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c4e360a4-9c10-4e63-90b5-c5cadc222582 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/ips" status: 200 len: 150 microversion: 2.1 time: 0.039387 Jun 23 12:02:33.008504 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 581/1066] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 12:02:32 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:33.162874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:33.163497 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:33.170772 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.171233 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.172014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.172452 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.224145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:33.224808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:33.242207 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.242658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.244311 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.244785 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.338051 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:33.350264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:33.352064 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:33.354811 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7e7c55a1-5a8a-43dd-98e5-dfa3b2a2cb60 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.195354 Jun 23 12:02:33.355394 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 486/1067] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:33 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:33.447102 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:33.454891 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-da0c3feb-a27a-4e25-8c3a-145b78c8d089 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.234744 Jun 23 12:02:33.455544 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 582/1068] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:33 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:33.833521 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-3cd72b5e-a23e-4d0d-91ea-e768fc19546b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:33.834532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-3cd72b5e-a23e-4d0d-91ea-e768fc19546b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:33.841403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd72b5e-a23e-4d0d-91ea-e768fc19546b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.841859 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd72b5e-a23e-4d0d-91ea-e768fc19546b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.842632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd72b5e-a23e-4d0d-91ea-e768fc19546b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.843076 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-3cd72b5e-a23e-4d0d-91ea-e768fc19546b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.871336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-3cd72b5e-a23e-4d0d-91ea-e768fc19546b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041886 Jun 23 12:02:33.871891 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 487/1069] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:33 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 12:02:33.976590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-742fa475-8100-4580-83b0-6215bb5a260c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:33.977675 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-742fa475-8100-4580-83b0-6215bb5a260c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:33.983799 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-742fa475-8100-4580-83b0-6215bb5a260c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.984169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-742fa475-8100-4580-83b0-6215bb5a260c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:33.984969 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-742fa475-8100-4580-83b0-6215bb5a260c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:33.985408 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-742fa475-8100-4580-83b0-6215bb5a260c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.014382 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-742fa475-8100-4580-83b0-6215bb5a260c tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.041712 Jun 23 12:02:34.015074 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 583/1070] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:33 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5/os-volume_attachments => generated 25 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 23 12:02:34.071742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:34.072248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:34.078179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.078621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.079373 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.079803 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.106625 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:02:34.182804 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-48a323f2-e27f-4102-b432-5506f7eaa1d8 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 204 len: 0 microversion: 2.1 time: 0.114556 Jun 23 12:02:34.183456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 488/1071] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:34 2022] DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 0 bytes in 116 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:02:34.191798 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:34.192423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:34.198432 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.198887 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.199649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.200086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.344474 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:34.354037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-623321bf-b167-4730-b0d2-09002b51027e tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1672 microversion: 2.1 time: 0.164828 Jun 23 12:02:34.354993 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 584/1072] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:34 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1672 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:34.374062 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6d3df7ae-92eb-4475-90b4-13a5115fbc32 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "68ac894a-1d21-447b-8024-0684e5f4836a"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:34.374660 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:34.375355 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-6d3df7ae-92eb-4475-90b4-13a5115fbc32 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:34.375730 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:34.381953 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.382551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.382701 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d3df7ae-92eb-4475-90b4-13a5115fbc32 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.383005 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d3df7ae-92eb-4475-90b4-13a5115fbc32 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.383348 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.384455 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d3df7ae-92eb-4475-90b4-13a5115fbc32 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.384568 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.385123 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-6d3df7ae-92eb-4475-90b4-13a5115fbc32 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.482468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:34.537169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:34.547423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:34.549132 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:34.550648 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b6832722-f2bc-426c-822c-1befdb62138c tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.180550 Jun 23 12:02:34.551378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 585/1073] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:34 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:02:34.556533 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:34.557389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:34.565039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.565528 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.566442 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:34.566891 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:34.724128 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:34.735819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-baaf8a72-b7f5-4913-92b8-b482d9a976da tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.182736 Jun 23 12:02:34.736651 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 586/1074] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:34 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:35.373653 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:35.374335 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:35.380785 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:35.381229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:35.381981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:35.382409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:35.518000 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:35.525740 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-02fbd9c1-8249-442e-919e-edf19c1ee59f tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1672 microversion: 2.1 time: 0.156131 Jun 23 12:02:35.526305 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 587/1075] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:35 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1672 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:35.570976 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:35.571597 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:35.577557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:35.577990 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:35.578754 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:35.579191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:35.714703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:35.723316 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:35.724949 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:35.726335 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-de2dca30-d3da-4bb2-a33c-24ea906bf6c4 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1732 microversion: 2.20 time: 0.159091 Jun 23 12:02:35.726891 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 588/1076] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:35 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1732 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 23 12:02:35.760378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:35.761155 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:35.771177 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:35.771632 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:35.772552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:35.772950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:35.908206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:35.916418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9bd62ba7-e6dc-4247-bf93-050e4df038eb tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.159987 Jun 23 12:02:35.917012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 589/1077] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:35 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:02:36.357266 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6d3df7ae-92eb-4475-90b4-13a5115fbc32 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "POST /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.989767 Jun 23 12:02:36.357878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 489/1078] 10.222.0.67 () {60 vars in 1322 bytes} [Thu Jun 23 12:02:34 2022] POST /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments => generated 194 bytes in 1991 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:36.541835 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:36.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:36.549737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:36.550477 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:36.551376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:36.551903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:36.689502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:36.697436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c9656bf9-ad7c-49a1-bde1-2122b6fd9648 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1672 microversion: 2.1 time: 0.159644 Jun 23 12:02:36.698001 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 590/1079] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:36 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1672 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:36.746314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:36.747082 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:36.755031 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:36.755406 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:36.756199 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:36.756640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:36.934379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:36.935179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:36.941508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:36.942024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:36.942789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:36.943294 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:36.999156 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:37.010259 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:37.013876 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:37.015454 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b454c93d-8236-4092-bcae-ce2476da6d9f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1719 microversion: 2.20 time: 0.275622 Jun 23 12:02:37.016048 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 490/1080] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:02:36 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1719 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:02:37.121522 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:37.125356 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:37.136325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e7afccf5-9e19-418c-ba69-21189c2130ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.206589 Jun 23 12:02:37.146301 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 591/1081] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:36 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:02:37.343620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-58eb0df4-61f5-46ff-876c-56e24f797e11 req-0ada2419-77b9-4ed8-a08f-a9123638a1cc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "55cdb509-57bb-458f-969a-99f8da10eea5", "name": "network-vif-deleted", "tag": "4bdd1459-2b27-4ac0-9b5f-00e9113b956f"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:37.351469 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-58eb0df4-61f5-46ff-876c-56e24f797e11 req-0ada2419-77b9-4ed8-a08f-a9123638a1cc service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:37.351916 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-58eb0df4-61f5-46ff-876c-56e24f797e11 req-0ada2419-77b9-4ed8-a08f-a9123638a1cc service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:37.363978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-58eb0df4-61f5-46ff-876c-56e24f797e11 req-0ada2419-77b9-4ed8-a08f-a9123638a1cc service nova] Creating event network-vif-deleted:4bdd1459-2b27-4ac0-9b5f-00e9113b956f for instance 55cdb509-57bb-458f-969a-99f8da10eea5 on hv-cinder-82660 Jun 23 12:02:37.370245 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-58eb0df4-61f5-46ff-876c-56e24f797e11 req-0ada2419-77b9-4ed8-a08f-a9123638a1cc service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030549 Jun 23 12:02:37.371754 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 491/1082] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:02:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:37.714950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:37.715746 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:37.718310 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=62 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:37.723866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:37.724414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:37.725273 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:37.725805 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:37.758384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:37.759455 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:37.759967 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lazy-loading 'fault' on Instance uuid 55cdb509-57bb-458f-969a-99f8da10eea5 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:02:37.807060 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9ab84989dd384d15b316b20cc65e792a', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a1a92a7ffc864256b48a9848b27f9fd2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:37.815954 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-5b439a6d-769b-46c1-bc50-f544e6a2071b tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 200 len: 1327 microversion: 2.1 time: 0.105174 Jun 23 12:02:37.816806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 592/1083] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:37 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 1327 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:38.156111 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:38.156851 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:38.163858 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:38.164538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:38.166243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:38.166699 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:38.320413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:38.328698 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-eb6bbf14-17ca-4721-abad-caae5d9c4c98 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.177848 Jun 23 12:02:38.329273 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 492/1084] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:38 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:38.834331 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:38.834919 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:38.842623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:38.843077 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:38.843857 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:38.844292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:38.859385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] HTTP exception thrown: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Request method failure captured: Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 HTTP/1.1 Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSUIjBx_dL752zPMuUaB_COk_lLic2QQ9fZPZ3sK79QRQRbPgLSZh0lryrfYdU-n_4Eymga-Fs3UvxxcH4x7x3RwHaAa7XwA0xOi6XKUDC2avlKdQrNADhvHSSnX8XOg80f5mKDAdhgCYx1XF2mGWjrSxuLFLt2BKX0vkVOStN3VeM Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:02:38.861120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9ab84989dd384d15b316b20cc65e792a Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:38.862861 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '55cdb509-57bb-458f-969a-99f8da10eea5'} Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:38.863793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:38.865374 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:38.867229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Returning 404 to user: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:38.867229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a2d5956b-546e-4642-898c-fe68c9001ee9 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 404 len: 111 microversion: 2.1 time: 0.032469 Jun 23 12:02:38.867229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 593/1085] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:38 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 12:02:38.876343 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-9fd3ee02-4010-496d-9b89-af0c18e05d46 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '.version_select at 0x7f3ae5fd5b80>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:38.897875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-9fd3ee02-4010-496d-9b89-af0c18e05d46 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-183096472" status: 202 len: 0 microversion: 2.1 time: 0.025532 Jun 23 12:02:38.898703 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 493/1086] 10.222.0.67 () {58 vars in 1217 bytes} [Thu Jun 23 12:02:38 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-183096472 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:02:39.345404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:39.346014 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:39.353077 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:39.353576 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:39.354379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:39.354886 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:39.569580 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:39.587112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-52d0c28f-e868-41e9-b227-45cf5c8c24e2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.245036 Jun 23 12:02:39.597466 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 594/1087] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:39 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:40.605176 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:40.607154 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:40.615658 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:40.616110 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:40.616924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:40.617365 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:40.757127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:40.765669 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-105c459f-0a5f-440e-90b2-376430dbc4ea tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.164868 Jun 23 12:02:40.766465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 494/1088] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:40 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:41.782124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:41.782736 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:41.789425 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:41.789884 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:41.790649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:41.791086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:41.857235 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:41.857777 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:41.864452 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:41.865023 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:41.865861 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:41.866360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:41.881006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] HTTP exception thrown: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Request method failure captured: Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 HTTP/1.1 Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSUIjBx_dL752zPMuUaB_COk_lLic2QQ9fZPZ3sK79QRQRbPgLSZh0lryrfYdU-n_4Eymga-Fs3UvxxcH4x7x3RwHaAa7XwA0xOi6XKUDC2avlKdQrNADhvHSSnX8XOg80f5mKDAdhgCYx1XF2mGWjrSxuLFLt2BKX0vkVOStN3VeM Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:41.882742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9ab84989dd384d15b316b20cc65e792a Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.884976 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '55cdb509-57bb-458f-969a-99f8da10eea5'} Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:41.885871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.890127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.891629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Returning 404 to user: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:41.891629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ae366fd8-d76a-4f4f-9e41-170805c52d03 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 404 len: 111 microversion: 2.1 time: 0.032613 Jun 23 12:02:41.891629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 495/1089] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:41 2022] DELETE /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 12:02:41.894655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:41.895265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 55cdb509-57bb-458f-969a-99f8da10eea5] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:41.901314 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:41.901756 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:41.902520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:41.902951 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:41.919987 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] HTTP exception thrown: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Request method failure captured: Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 HTTP/1.1 Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSUIjBx_dL752zPMuUaB_COk_lLic2QQ9fZPZ3sK79QRQRbPgLSZh0lryrfYdU-n_4Eymga-Fs3UvxxcH4x7x3RwHaAa7XwA0xOi6XKUDC2avlKdQrNADhvHSSnX8XOg80f5mKDAdhgCYx1XF2mGWjrSxuLFLt2BKX0vkVOStN3VeM Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:41.921468 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9ab84989dd384d15b316b20cc65e792a Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.922996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '55cdb509-57bb-458f-969a-99f8da10eea5'} Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:41.923927 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. Jun 23 12:02:41.925431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:41.926535 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Returning 404 to user: Instance 55cdb509-57bb-458f-969a-99f8da10eea5 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:41.926535 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-51dd9dde-55e7-44fe-a964-2567e087de55 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5" status: 404 len: 111 microversion: 2.1 time: 0.031913 Jun 23 12:02:41.926535 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 496/1090] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:41 2022] GET /compute/v2.1/servers/55cdb509-57bb-458f-969a-99f8da10eea5 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 12:02:41.936000 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:41.943844 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ed75c6a6-a9a1-41db-8c4f-87c0294d84ac tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.165635 Jun 23 12:02:41.944419 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 595/1091] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:41 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:42.943034 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:42.943522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:42.945940 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=62,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:42.952384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:42.952871 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:42.953742 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:42.954236 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:42.964079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:42.965080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:42.972974 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:42.973537 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:42.975371 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:42.976043 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:43.044102 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lazy-loading 'services' on Instance uuid 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:02:43.127941 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-dcb2ef42-0e4c-41a5-80c3-f2b423a3c51d tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments/68ac894a-1d21-447b-8024-0684e5f4836a" status: 202 len: 0 microversion: 2.1 time: 0.188464 Jun 23 12:02:43.128878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 497/1092] 10.222.0.67 () {58 vars in 1415 bytes} [Thu Jun 23 12:02:42 2022] DELETE /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments/68ac894a-1d21-447b-8024-0684e5f4836a => generated 0 bytes in 190 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:02:43.134344 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:43.135499 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:43.143075 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:43.143624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:43.144502 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:43.145056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:43.145679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:43.157492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e8845a42-184d-4af9-a425-e59d3c362412 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.200153 Jun 23 12:02:43.158488 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 596/1093] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:42 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:43.162166 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] HTTP exception thrown: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.163875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-596fc242-53a2-423a-98ee-af0a52e6fc17 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Request method failure captured: Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 HTTP/1.1 Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSUIjBx_dL752zPMuUaB_COk_lLic2QQ9fZPZ3sK79QRQRbPgLSZh0lryrfYdU-n_4Eymga-Fs3UvxxcH4x7x3RwHaAa7XwA0xOi6XKUDC2avlKdQrNADhvHSSnX8XOg80f5mKDAdhgCYx1XF2mGWjrSxuLFLt2BKX0vkVOStN3VeM Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:43.164336 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9ab84989dd384d15b316b20cc65e792a Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.166527 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '7134bd36-8b37-48ff-bcfb-ab369c0ef601'} Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:43.167305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.168869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.170365 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-596fc242-53a2-423a-98ee-af0a52e6fc17 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:43.171590 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Returning 404 to user: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:43.172619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d81da410-36fa-4605-b245-8e0610af88ba tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "DELETE /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 404 len: 111 microversion: 2.1 time: 0.042429 Jun 23 12:02:43.173365 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 498/1094] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:43 2022] DELETE /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 111 bytes in 44 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:43.176502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-596fc242-53a2-423a-98ee-af0a52e6fc17 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:43.176502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-596fc242-53a2-423a-98ee-af0a52e6fc17 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:43.176502 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-596fc242-53a2-423a-98ee-af0a52e6fc17 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:43.177102 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-596fc242-53a2-423a-98ee-af0a52e6fc17 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:43.182321 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:43.182939 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] [instance: 7134bd36-8b37-48ff-bcfb-ab369c0ef601] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:43.189008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:43.189449 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:43.190210 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:43.190639 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:43.204238 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] HTTP exception thrown: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Request method failure captured: Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 HTTP/1.1 Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSUIjBx_dL752zPMuUaB_COk_lLic2QQ9fZPZ3sK79QRQRbPgLSZh0lryrfYdU-n_4Eymga-Fs3UvxxcH4x7x3RwHaAa7XwA0xOi6XKUDC2avlKdQrNADhvHSSnX8XOg80f5mKDAdhgCYx1XF2mGWjrSxuLFLt2BKX0vkVOStN3VeM Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:43.205784 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a1a92a7ffc864256b48a9848b27f9fd2"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: a1a92a7ffc864256b48a9848b27f9fd2 Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1397890050 Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9ab84989dd384d15b316b20cc65e792a Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeTestJSON-1397890050-project Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.207444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '7134bd36-8b37-48ff-bcfb-ab369c0ef601'} Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:43.208558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. Jun 23 12:02:43.209979 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:43.212374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] Returning 404 to user: Instance 7134bd36-8b37-48ff-bcfb-ab369c0ef601 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:43.212374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7afe722b-96e6-42ff-b3d0-151f4cbb2df7 tempest-AttachVolumeTestJSON-1397890050 tempest-AttachVolumeTestJSON-1397890050-project] 10.222.0.67 "GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601" status: 404 len: 111 microversion: 2.1 time: 0.029148 Jun 23 12:02:43.212374 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 499/1095] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:43 2022] GET /compute/v2.1/servers/7134bd36-8b37-48ff-bcfb-ab369c0ef601 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:43.212936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-596fc242-53a2-423a-98ee-af0a52e6fc17 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049322 Jun 23 12:02:43.212936 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 597/1096] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:43 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:44.176640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:44.177280 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:44.184854 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:44.185330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:44.186106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:44.186535 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:44.221079 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0c48db37-4eba-44a4-b433-5636ed477010 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:44.223366 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0c48db37-4eba-44a4-b433-5636ed477010 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:44.231626 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c48db37-4eba-44a4-b433-5636ed477010 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:44.232358 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c48db37-4eba-44a4-b433-5636ed477010 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:44.233471 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c48db37-4eba-44a4-b433-5636ed477010 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:44.234162 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c48db37-4eba-44a4-b433-5636ed477010 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:44.270883 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0c48db37-4eba-44a4-b433-5636ed477010 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053580 Jun 23 12:02:44.271783 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 598/1097] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:44 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:02:44.350767 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:44.360382 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-da72415c-38e3-42bc-b108-7b86d6d576ad tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.187720 Jun 23 12:02:44.361101 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 500/1098] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:44 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:45.283793 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-58fc0496-0b90-4127-84ae-caa7e507238e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:45.285916 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-58fc0496-0b90-4127-84ae-caa7e507238e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:45.293729 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58fc0496-0b90-4127-84ae-caa7e507238e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:45.294562 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58fc0496-0b90-4127-84ae-caa7e507238e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:45.295751 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58fc0496-0b90-4127-84ae-caa7e507238e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:45.296415 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58fc0496-0b90-4127-84ae-caa7e507238e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:45.359384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-58fc0496-0b90-4127-84ae-caa7e507238e tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.079812 Jun 23 12:02:45.361003 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 599/1099] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:45 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments => generated 197 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:45.380021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:45.382006 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:45.393112 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:45.394503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:45.395413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:45.396431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:45.645067 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:45.654561 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ecbbef3f-2863-401f-be1e-7258332a6940 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.280143 Jun 23 12:02:45.655541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 501/1100] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:45 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:46.371584 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-20b3ef5c-8c9b-48a7-99b6-322a5cbd5048 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:46.372519 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-20b3ef5c-8c9b-48a7-99b6-322a5cbd5048 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:46.379687 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-20b3ef5c-8c9b-48a7-99b6-322a5cbd5048 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.380325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-20b3ef5c-8c9b-48a7-99b6-322a5cbd5048 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.381340 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-20b3ef5c-8c9b-48a7-99b6-322a5cbd5048 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.381809 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-20b3ef5c-8c9b-48a7-99b6-322a5cbd5048 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.425436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-20b3ef5c-8c9b-48a7-99b6-322a5cbd5048 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.057480 Jun 23 12:02:46.428812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 600/1101] 10.222.0.67 () {58 vars in 1301 bytes} [Thu Jun 23 12:02:46 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1/os-volume_attachments => generated 25 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 23 12:02:46.491081 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:46.491679 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:46.498960 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.499412 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.500850 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.501533 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.537362 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:02:46.634178 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b7bd42c0-8831-4935-974d-303488b84a66 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 204 len: 0 microversion: 2.1 time: 0.146547 Jun 23 12:02:46.637898 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 502/1102] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:46 2022] DELETE /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:02:46.645021 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:46.645867 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:46.653318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.653898 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.654731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.655233 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.673540 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:46.674511 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:46.683316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.684026 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.685025 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.686478 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.847002 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:46.855980 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-be796722-8045-490e-a1cb-19b0ba6c3e05 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1510 microversion: 2.1 time: 0.187068 Jun 23 12:02:46.856581 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 503/1103] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:46 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1510 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:46.872610 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-36bb8316-d3d9-4ce6-a2fa-073a3330160d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:46.873258 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-36bb8316-d3d9-4ce6-a2fa-073a3330160d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:46.879839 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36bb8316-d3d9-4ce6-a2fa-073a3330160d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.880295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36bb8316-d3d9-4ce6-a2fa-073a3330160d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.881103 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36bb8316-d3d9-4ce6-a2fa-073a3330160d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:46.881655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-36bb8316-d3d9-4ce6-a2fa-073a3330160d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:46.913523 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:46.923600 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9e8243ee-5c52-4545-aa26-6b049fa4eb6a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1679 microversion: 2.1 time: 0.284229 Jun 23 12:02:46.924182 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 601/1104] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:46 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1679 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:46.983444 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-36bb8316-d3d9-4ce6-a2fa-073a3330160d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "POST /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83/action" status: 202 len: 0 microversion: 2.1 time: 0.114840 Jun 23 12:02:46.987051 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 504/1105] 10.222.0.67 () {60 vars in 1277 bytes} [Thu Jun 23 12:02:46 2022] POST /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83/action => generated 0 bytes in 116 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 12:02:46.996202 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:46.997299 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:47.006206 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:47.007112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:47.008213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:47.008768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:47.155386 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:47.163627 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-516ed677-e3fd-4601-b42b-f231b834411e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1518 microversion: 2.1 time: 0.174716 Jun 23 12:02:47.164371 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 602/1106] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:46 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1518 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:47.626491 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-96ec6cc8-b6c9-4227-ab36-fffe67ff6ee6 req-f0612d2c-64b6-4230-98e1-7bb8b181b48e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442b025-7b22-40c8-8f76-3a3379bf8e83", "name": "network-vif-unplugged", "status": "completed", "tag": "4f655e92-f7d0-4eb3-aa0d-313d293bd617"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:47.638705 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-96ec6cc8-b6c9-4227-ab36-fffe67ff6ee6 req-f0612d2c-64b6-4230-98e1-7bb8b181b48e service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:47.639431 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-96ec6cc8-b6c9-4227-ab36-fffe67ff6ee6 req-f0612d2c-64b6-4230-98e1-7bb8b181b48e service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:47.655163 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.compute.server_external_events [req-96ec6cc8-b6c9-4227-ab36-fffe67ff6ee6 req-f0612d2c-64b6-4230-98e1-7bb8b181b48e service nova] Unable to find a host for instance 9442b025-7b22-40c8-8f76-3a3379bf8e83. Dropping event network-vif-unplugged {{(pid=117747) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 23 12:02:47.657618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-96ec6cc8-b6c9-4227-ab36-fffe67ff6ee6 req-f0612d2c-64b6-4230-98e1-7bb8b181b48e service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035516 Jun 23 12:02:47.659078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 505/1107] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:02:47 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 39 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 23 12:02:47.945086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:47.945806 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:47.954332 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:47.955435 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:47.956370 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:47.956705 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:48.105714 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:48.113514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9f611c09-0ee9-4eef-82d3-33f7d0d18e3a tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1679 microversion: 2.1 time: 0.176181 Jun 23 12:02:48.123856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 603/1108] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:47 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1679 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:48.181615 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:48.182238 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:48.189238 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:48.189835 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:48.190629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:48.191068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:48.344143 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:48.346750 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=92,nova_cell1:UPDATE=4,nova_cell1:INSERT=4 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:48.357868 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-337c11f7-753a-40c1-956a-5ba478884eb9 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1518 microversion: 2.1 time: 0.180733 Jun 23 12:02:48.358459 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 506/1109] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:48 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1518 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:49.131292 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:49.131914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:49.139186 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:49.139568 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:49.140350 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:49.140812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:49.207345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:49.215803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d19038d7-87f6-4f2b-9510-84b2dc573a88 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1612 microversion: 2.1 time: 0.088230 Jun 23 12:02:49.216494 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 604/1110] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:49 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1612 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:49.281584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-909dd2f6-e937-4a1b-b967-fca770e92566 req-531a588f-0f2d-4e7e-9a2b-4eeeee3b13e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1", "name": "network-vif-deleted", "tag": "23b9efef-6889-4666-ac0e-537e6c48240c"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:49.291138 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-909dd2f6-e937-4a1b-b967-fca770e92566 req-531a588f-0f2d-4e7e-9a2b-4eeeee3b13e4 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:49.291670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-909dd2f6-e937-4a1b-b967-fca770e92566 req-531a588f-0f2d-4e7e-9a2b-4eeeee3b13e4 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:49.302997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-909dd2f6-e937-4a1b-b967-fca770e92566 req-531a588f-0f2d-4e7e-9a2b-4eeeee3b13e4 service nova] Creating event network-vif-deleted:23b9efef-6889-4666-ac0e-537e6c48240c for instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 on hv-cinder-82660 Jun 23 12:02:49.308542 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-909dd2f6-e937-4a1b-b967-fca770e92566 req-531a588f-0f2d-4e7e-9a2b-4eeeee3b13e4 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030667 Jun 23 12:02:49.309606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 507/1111] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:02:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:49.375485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:49.376396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:49.382542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:49.383031 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:49.383866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:49.384485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:49.556244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:49.568402 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8dcc5a15-4581-4ab9-8137-307aeef34e77 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1520 microversion: 2.1 time: 0.196875 Jun 23 12:02:49.571790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 605/1112] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:49 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:49.840685 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-757d38ec-eb68-4f52-b1a3-a11504341d9b tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae6283dc0>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:49.887864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-757d38ec-eb68-4f52-b1a3-a11504341d9b tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/a6137ea8-721b-4470-80aa-c984eb35d566" status: 200 len: 351 microversion: 2.1 time: 0.051802 Jun 23 12:02:49.888534 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 508/1113] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:02:49 2022] GET /compute/v2.1/os-volumes/a6137ea8-721b-4470-80aa-c984eb35d566 => generated 351 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:50.233480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:50.234135 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:50.251085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:50.255556 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:50.256529 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:50.260579 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:50.319991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:50.320494 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:50.321526 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.objects.instance [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lazy-loading 'fault' on Instance uuid 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 {{(pid=117746) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:02:50.380341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9cc891cc8172490394d2bfa3c8d1dcf8', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b4f73dfee32d43b985e9192000eaed8c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:50.388719 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a5659c7c-8775-4278-90c5-4db01a18bc49 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 200 len: 1329 microversion: 2.1 time: 0.159269 Jun 23 12:02:50.389550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 606/1114] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:50 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 1329 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:50.594166 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:50.595552 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:50.603348 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:50.603805 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:50.604646 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:50.605185 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:50.820293 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:50.828033 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-84035e90-244e-415a-ad51-594a1828b180 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.245955 Jun 23 12:02:50.828604 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 509/1115] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:50 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:51.235046 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-2398c7b3-ad15-4b6b-8207-0685651eed50 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3aea669d30>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:51.282106 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-2398c7b3-ad15-4b6b-8207-0685651eed50 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/08e44572-93b4-44db-95e1-74231684a0f2" status: 200 len: 351 microversion: 2.1 time: 0.050771 Jun 23 12:02:51.282666 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 607/1116] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:02:51 2022] GET /compute/v2.1/os-volumes/08e44572-93b4-44db-95e1-74231684a0f2 => generated 351 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:51.406257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:51.407064 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:51.413640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:51.414183 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:51.415015 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:51.415525 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:51.429761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 HTTP/1.1 Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:51.432324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:51.434072 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1'} Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:51.435063 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:51.436337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:51.437858 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:51.437858 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-18a2f44a-7be3-4d95-a58a-4a17407ce6cc tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 404 len: 111 microversion: 2.1 time: 0.031582 Jun 23 12:02:51.437858 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 510/1117] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:51 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:51.443515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-14aea81e-75f2-4717-935c-693296416b7f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '.version_select at 0x7f3ae60c1820>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:51.463224 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-14aea81e-75f2-4717-935c-693296416b7f tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-22934250" status: 202 len: 0 microversion: 2.1 time: 0.023389 Jun 23 12:02:51.463841 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 608/1118] 10.222.0.67 () {58 vars in 1214 bytes} [Thu Jun 23 12:02:51 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-22934250 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:02:51.846480 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:51.847100 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:51.853838 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:51.854289 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:51.855067 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:51.855502 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:52.060454 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:52.068688 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-45ad235b-eea5-4f6a-b0f9-3138b7dd1df6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.226509 Jun 23 12:02:52.069271 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 511/1119] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:51 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:52.615882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f124c88e-9f85-44db-94c8-3eb3bf0609ed tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3aea6774c0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:52.664090 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f124c88e-9f85-44db-94c8-3eb3bf0609ed tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/f8569d9b-1cf2-453b-a412-44eae1adf344" status: 200 len: 350 microversion: 2.1 time: 0.052367 Jun 23 12:02:52.669950 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 609/1120] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:02:52 2022] GET /compute/v2.1/os-volumes/f8569d9b-1cf2-453b-a412-44eae1adf344 => generated 350 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:52.676298 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-41b35118-eaf9-476f-ba29-3fd122740560 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae5f65310>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:52.756786 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-41b35118-eaf9-476f-ba29-3fd122740560 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.084572 Jun 23 12:02:52.757387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 512/1121] 10.222.0.67 () {58 vars in 1133 bytes} [Thu Jun 23 12:02:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:52.771010 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b8faa198-3be5-4d50-8bb8-edbe932b70f9 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae5f9b280>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:52.858064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b8faa198-3be5-4d50-8bb8-edbe932b70f9 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.090761 Jun 23 12:02:52.858634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 610/1122] 10.222.0.67 () {58 vars in 1148 bytes} [Thu Jun 23 12:02:52 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 694 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:52.870656 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0d63b7c6-81cc-4ee6-926d-571f1f505247 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae5f4eca0>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:52.954204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0d63b7c6-81cc-4ee6-926d-571f1f505247 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.087722 Jun 23 12:02:52.954769 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 513/1123] 10.222.0.67 () {58 vars in 1133 bytes} [Thu Jun 23 12:02:52 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:52.966255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-70b60d06-625d-4eb1-890b-1e14a2f79530 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae5f0f430>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.051075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-70b60d06-625d-4eb1-890b-1e14a2f79530 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.088548 Jun 23 12:02:53.051670 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 611/1124] 10.222.0.67 () {58 vars in 1166 bytes} [Thu Jun 23 12:02:52 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:53.063035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-cffcdf24-3d30-4739-98d8-f368df806c2e tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae5f4e5e0>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.086240 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.087431 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:53.094034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:53.094485 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:53.095248 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:53.095700 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:53.145624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-cffcdf24-3d30-4739-98d8-f368df806c2e tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 694 microversion: 2.1 time: 0.086274 Jun 23 12:02:53.146285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 514/1125] 10.222.0.67 () {58 vars in 1169 bytes} [Thu Jun 23 12:02:53 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 694 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:53.158316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b2b51234-4f84-4a4d-8fed-9485c0879831 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae5f65820>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.230514 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:53.238665 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7b52c24e-8d84-43a8-9649-1bc3bc000f32 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.156193 Jun 23 12:02:53.238853 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b2b51234-4f84-4a4d-8fed-9485c0879831 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.084162 Jun 23 12:02:53.239244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 612/1126] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:53 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:02:53.239394 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 515/1127] 10.222.0.67 () {58 vars in 1154 bytes} [Thu Jun 23 12:02:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:02:53.250742 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-01959c53-1955-4a3d-9da2-c433b1616a02 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3aea6698b0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.307376 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.307878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:53.314376 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:53.314831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:53.315608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:53.316044 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:53.330355 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.331272 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-01959c53-1955-4a3d-9da2-c433b1616a02 tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.084271 Jun 23 12:02:53.331914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 613/1128] 10.222.0.67 () {58 vars in 1187 bytes} [Thu Jun 23 12:02:53 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 HTTP/1.1 Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:53.332078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.333584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1'} Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:53.334486 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.337164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.338993 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:53.338993 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-32a71fd2-e676-42f7-9275-2686228002ca tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 404 len: 111 microversion: 2.1 time: 0.029942 Jun 23 12:02:53.338993 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 516/1129] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:53 2022] DELETE /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 12:02:53.342331 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.342937 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:53.345267 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-367ebb72-e74e-4f1c-b17e-f78cbd21822b tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] Calling method '.version_select at 0x7f3ae615b550>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:53.349027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:53.349503 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:53.350258 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:53.350683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:53.366122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 HTTP/1.1 Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:02:53.367732 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.369978 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1'} Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:53.370839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. Jun 23 12:02:53.372379 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:53.373824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance 604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:53.373824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-0c80bf68-3975-400b-8183-0da59436359b tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1" status: 404 len: 111 microversion: 2.1 time: 0.031142 Jun 23 12:02:53.373824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 614/1130] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:53 2022] GET /compute/v2.1/servers/604301cf-2c9e-4e3c-8ea9-7ccf1e5da4a1 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:53.433382 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-367ebb72-e74e-4f1c-b17e-f78cbd21822b tempest-VolumesTestJSON-1631573366 tempest-VolumesTestJSON-1631573366-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.091668 Jun 23 12:02:53.433942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 517/1131] 10.222.0.67 () {58 vars in 1154 bytes} [Thu Jun 23 12:02:53 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:02:54.255984 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:54.256597 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:54.263831 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.264281 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.265068 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.265492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.269571 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=100 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:02:54.397786 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:54.405277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-818da947-d12e-4c09-ab69-a2f0c3e74352 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.153167 Jun 23 12:02:54.405925 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 615/1132] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:54 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:54.503173 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:54.503676 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:54.511133 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.511541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.512323 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.512985 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.529681 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc HTTP/1.1 Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:54.531239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.532990 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '429b22b9-be19-4630-80e1-18b745a0eedc'} Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:54.534039 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.535538 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.537162 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:54.537162 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-92881b44-05e3-4ee9-ae17-268806d39c8c tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 404 len: 111 microversion: 2.1 time: 0.033805 Jun 23 12:02:54.537162 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 518/1133] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:54 2022] DELETE /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:54.541191 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:54.541807 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: 429b22b9-be19-4630-80e1-18b745a0eedc] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:54.547819 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.548267 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.549056 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.549487 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.563505 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc HTTP/1.1 Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:02:54.565042 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.566548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '429b22b9-be19-4630-80e1-18b745a0eedc'} Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:54.567321 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. Jun 23 12:02:54.568635 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.570661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance 429b22b9-be19-4630-80e1-18b745a0eedc could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:54.570661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-438e1787-7cdd-4492-90fb-acf5d9d50106 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc" status: 404 len: 111 microversion: 2.1 time: 0.029112 Jun 23 12:02:54.570661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 616/1134] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:54 2022] GET /compute/v2.1/servers/429b22b9-be19-4630-80e1-18b745a0eedc => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:54.575606 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:54.576105 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:54.582263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.582709 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.583469 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.583905 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.597239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a HTTP/1.1 Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:54.598791 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.600409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'b2a64ae5-5786-41de-9862-e321b902937a'} Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:54.601782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.603568 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.606021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:54.606021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d149e7fc-a637-427a-b789-762738022cf2 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 404 len: 111 microversion: 2.1 time: 0.029008 Jun 23 12:02:54.606021 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 519/1135] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:54 2022] DELETE /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:54.609792 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:54.610479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: b2a64ae5-5786-41de-9862-e321b902937a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:54.617395 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.617843 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.618615 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:54.619048 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:54.634244 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a HTTP/1.1 Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:02:54.636548 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.638256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'b2a64ae5-5786-41de-9862-e321b902937a'} Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:54.639055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. Jun 23 12:02:54.640308 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:54.641783 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance b2a64ae5-5786-41de-9862-e321b902937a could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:54.641783 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6201a6fa-9855-4cff-9fb6-74b272e06ac1 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a" status: 404 len: 111 microversion: 2.1 time: 0.032950 Jun 23 12:02:54.641783 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 617/1136] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:54 2022] GET /compute/v2.1/servers/b2a64ae5-5786-41de-9862-e321b902937a => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:55.421270 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:55.421886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:55.428281 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:55.428758 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:55.429528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:55.429967 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:55.561961 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:55.569490 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-22c97fdc-ba7f-4828-ac29-c6d71854e3d2 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.152096 Jun 23 12:02:55.570041 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 520/1137] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:55 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:55.795102 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:55.795788 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:55.802940 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:55.803397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:55.804174 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:55.804614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:55.819614 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: DELETE /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a HTTP/1.1 Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:02:55.821197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.823465 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'd67c82c1-7c40-43a6-9326-480dc5fcb37a'} Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:55.824330 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.825636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.827153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:55.827153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e16a75f4-7b7b-40d2-9a2c-63ce8fb0e147 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "DELETE /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 404 len: 111 microversion: 2.1 time: 0.031773 Jun 23 12:02:55.827153 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 618/1138] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:02:55 2022] DELETE /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:55.831902 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:55.832569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] [instance: d67c82c1-7c40-43a6-9326-480dc5fcb37a] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:55.838793 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:55.839243 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:55.840007 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:55.840445 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:55.853844 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] HTTP exception thrown: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Request method failure captured: Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a HTTP/1.1 Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSVvuZg9xzQNgCtsuW5UvhXL9ZoFmebYN0e3jBuoqSQ_4oCjjVr3xNwUKjpVxl2EWJoGT0Si56H88HrNO2P0AihWXWiEt4Lg4heH8axppq9tlTzW43IR1HpDkHTa0QjAldBoDil6IAskCAQyrlE941qX-OKcmlAd7evFtpY__iG4Jk Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:02:55.855360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_b4f73dfee32d43b985e9192000eaed8c"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: b4f73dfee32d43b985e9192000eaed8c Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-470095837 Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 9cc891cc8172490394d2bfa3c8d1dcf8 Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeNegativeTest-470095837-project Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.857122 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'd67c82c1-7c40-43a6-9326-480dc5fcb37a'} Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:02:55.858049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. Jun 23 12:02:55.859510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:02:55.860842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] Returning 404 to user: Instance d67c82c1-7c40-43a6-9326-480dc5fcb37a could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:02:55.860842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-aee78362-b0ae-4d36-8310-e950473cfca3 tempest-AttachVolumeNegativeTest-470095837 tempest-AttachVolumeNegativeTest-470095837-project] 10.222.0.67 "GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a" status: 404 len: 111 microversion: 2.1 time: 0.028699 Jun 23 12:02:55.860842 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 521/1139] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:55 2022] GET /compute/v2.1/servers/d67c82c1-7c40-43a6-9326-480dc5fcb37a => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:02:56.587486 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:56.588663 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:56.594761 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:56.595216 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:56.595983 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:56.596410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:56.735918 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:56.743503 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9b3f3bf6-6c62-4d1c-8b2d-d047a21c78f3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.160154 Jun 23 12:02:56.744094 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 619/1140] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:56 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:57.760491 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:57.761153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:57.771502 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:57.771975 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:57.772812 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:57.774008 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:58.069706 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:58.081239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1aa91ebe-7962-47a2-b9ef-616d500dc529 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.322163 Jun 23 12:02:58.081239 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 522/1141] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:57 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:59.097963 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:02:59.098570 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:02:59.107411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:59.108817 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:59.109483 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:59.109918 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:59.322221 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:02:59.330772 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-d4719d48-9b38-4ed6-819b-f2d193c6407e tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.236956 Jun 23 12:02:59.331664 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 620/1142] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:02:59 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:02:59.781629 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-cd72e3c2-ec61-471c-b373-45fcbbeb783e req-21ca8e6c-5395-4f1c-a8b0-474390ec669a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442b025-7b22-40c8-8f76-3a3379bf8e83", "name": "network-vif-plugged", "status": "completed", "tag": "4f655e92-f7d0-4eb3-aa0d-313d293bd617"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:02:59.817390 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-cd72e3c2-ec61-471c-b373-45fcbbeb783e req-21ca8e6c-5395-4f1c-a8b0-474390ec669a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:02:59.818963 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-cd72e3c2-ec61-471c-b373-45fcbbeb783e req-21ca8e6c-5395-4f1c-a8b0-474390ec669a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:02:59.853940 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-cd72e3c2-ec61-471c-b373-45fcbbeb783e req-21ca8e6c-5395-4f1c-a8b0-474390ec669a service nova] Creating event network-vif-plugged:4f655e92-f7d0-4eb3-aa0d-313d293bd617 for instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 on hv-cinder-82660 Jun 23 12:02:59.861620 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-cd72e3c2-ec61-471c-b373-45fcbbeb783e req-21ca8e6c-5395-4f1c-a8b0-474390ec669a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086011 Jun 23 12:02:59.862207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 523/1143] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:02:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:03:00.350220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:00.350905 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:00.358138 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:00.358675 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:00.359515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:00.359953 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:00.506767 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:00.517981 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-17cf60dd-0383-4e0d-a499-c569ede79ed3 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1576 microversion: 2.1 time: 0.171307 Jun 23 12:03:00.518931 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 621/1144] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:03:00 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1576 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:03:00.878223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8411f057-64f6-4808-9886-f87e24989537 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Action: 'create', calling method: .version_select at 0x7f3ae6030820>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1612053102"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:03:01.193265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8411f057-64f6-4808-9886-f87e24989537 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 0.428272 Jun 23 12:03:01.193895 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 524/1145] 10.222.0.67 () {60 vars in 1154 bytes} [Thu Jun 23 12:03:00 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 430 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 23 12:03:01.205678 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4ca7b388-dc74-43f7-9449-597159f588e6 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae60e09d0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:01.262280 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4ca7b388-dc74-43f7-9449-597159f588e6 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf" status: 200 len: 345 microversion: 2.1 time: 0.060475 Jun 23 12:03:01.262855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 622/1146] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:03:01 2022] GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf => generated 345 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:01.538438 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:01.539175 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:01.548273 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:01.548762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:01.549528 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:01.549974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:01.682217 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:01.689789 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5687f87e-80b9-4455-af58-7905daf304b6 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1563 microversion: 2.1 time: 0.155686 Jun 23 12:03:01.690360 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 525/1147] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:03:01 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1563 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:03:02.275192 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a594a040-0b93-44f6-9820-0e8eba00307e tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3aea669280>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:02.333391 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a594a040-0b93-44f6-9820-0e8eba00307e tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf" status: 200 len: 346 microversion: 2.1 time: 0.062320 Jun 23 12:03:02.333966 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 623/1148] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:03:02 2022] GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf => generated 346 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:02.345556 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-0238f0d6-fb24-491f-9c1d-1a56522de245 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Action: 'create', calling method: .version_select at 0x7f3ae6030d30>, body: {"snapshot": {"volume_id": "05fe4ef0-9eb2-4b59-8d97-81df085699bf", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-1244222156"}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:03:02.508328 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-0238f0d6-fb24-491f-9c1d-1a56522de245 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "POST /compute/v2.1/os-snapshots" status: 200 len: 287 microversion: 2.1 time: 0.166659 Jun 23 12:03:02.508947 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 526/1149] 10.222.0.67 () {60 vars in 1161 bytes} [Thu Jun 23 12:03:02 2022] POST /compute/v2.1/os-snapshots => generated 287 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:02.519317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cf1e26aa-f33b-42c1-bb37-e5ce227d78e8 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae5f9b820>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:02.550737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cf1e26aa-f33b-42c1-bb37-e5ce227d78e8 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 200 len: 287 microversion: 2.1 time: 0.035154 Jun 23 12:03:02.551515 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 624/1150] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 23 12:03:02 2022] GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:02.562044 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-6b2b29c8-b5fc-483d-a360-d88e3b8a97f2 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae60a2b80>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:02.592840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-6b2b29c8-b5fc-483d-a360-d88e3b8a97f2 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots" status: 200 len: 290 microversion: 2.1 time: 0.034396 Jun 23 12:03:02.593405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 527/1151] 10.222.0.67 () {58 vars in 1139 bytes} [Thu Jun 23 12:03:02 2022] GET /compute/v2.1/os-snapshots => generated 290 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:02.603911 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-48cf5795-b50b-4dce-8aa4-dbe75e09254a tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae5f9b310>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:02.634081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-48cf5795-b50b-4dce-8aa4-dbe75e09254a tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 200 len: 287 microversion: 2.1 time: 0.033954 Jun 23 12:03:02.635970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 625/1152] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 23 12:03:02 2022] GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 287 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:03.647939 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-8d5fc8d8-08ec-47bb-ab7a-1c0f2a0e5bb0 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae6030f70>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:03.678356 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-8d5fc8d8-08ec-47bb-ab7a-1c0f2a0e5bb0 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 200 len: 287 microversion: 2.1 time: 0.034971 Jun 23 12:03:03.678924 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 528/1153] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 23 12:03:03 2022] GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:04.690808 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-061a6841-529d-4488-83ac-ba686ef6dd4a tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae5f0f790>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:04.721124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-061a6841-529d-4488-83ac-ba686ef6dd4a tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 200 len: 287 microversion: 2.1 time: 0.034516 Jun 23 12:03:04.721765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 626/1154] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 23 12:03:04 2022] GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 287 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:05.733211 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-04f28e92-0a76-4b72-a34b-890c9df29fb3 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae63eb310>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:05.761377 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-04f28e92-0a76-4b72-a34b-890c9df29fb3 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 200 len: 288 microversion: 2.1 time: 0.033064 Jun 23 12:03:05.761930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 529/1155] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 23 12:03:05 2022] GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 288 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:05.772409 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-12c4d932-ea8b-45f4-82e4-84c92b69f984 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae60644c0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:05.830033 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-12c4d932-ea8b-45f4-82e4-84c92b69f984 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "DELETE /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 202 len: 0 microversion: 2.1 time: 0.061839 Jun 23 12:03:05.830609 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 627/1156] 10.222.0.67 () {58 vars in 1253 bytes} [Thu Jun 23 12:03:05 2022] DELETE /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 0 bytes in 63 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:03:05.839227 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d951d0a9-7a08-46b7-88d8-f79bb952ef06 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae5f4e940>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:05.868849 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d951d0a9-7a08-46b7-88d8-f79bb952ef06 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 200 len: 287 microversion: 2.1 time: 0.033730 Jun 23 12:03:05.869371 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 530/1157] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 23 12:03:05 2022] GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 287 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:06.880369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-34e70d51-b715-4679-9f30-1109c62775cd tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3aea686700>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:06.906800 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-34e70d51-b715-4679-9f30-1109c62775cd tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] HTTP exception thrown: Snapshot 9d5efd30-68f5-4c69-a4de-9664bf61b22b could not be found. Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-34e70d51-b715-4679-9f30-1109c62775cd tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Request method failure captured: Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b HTTP/1.1 Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFZ0OAzr9peG0r_MXBJipnpcCrhH0_fYE4RobFbg3Lw-KrBhcXzM8UpgkhQbiePTJbkgUXkLqyQ4y21dx-quFuIMNvDAKKd0eWAm_fWgoQJsvUQB-faeaNnMIbLffs9DCCemTu64qBlYngCAq3Vz-sV6LZ0BYmj-kcHm7jfUv6Hwec8 Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:06.909126 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 07d02953330044ce8d0c9d65591d0521 Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Snapshot 9d5efd30-68f5-4c69-a4de-9664bf61b22b could not be found. Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '9d5efd30-68f5-4c69-a4de-9664bf61b22b'} Jun 23 12:03:06.910557 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 9d5efd30-68f5-4c69-a4de-9664bf61b22b could not be found. (HTTP 404) (Request-ID: req-7edd034b-25cb-41f1-b22d-14b417108ae8) Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:06.911424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:06.912604 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 9d5efd30-68f5-4c69-a4de-9664bf61b22b could not be found. Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 23 12:03:06.913903 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 9d5efd30-68f5-4c69-a4de-9664bf61b22b could not be found. Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 9d5efd30-68f5-4c69-a4de-9664bf61b22b could not be found. Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-34e70d51-b715-4679-9f30-1109c62775cd tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Returning 404 to user: Snapshot 9d5efd30-68f5-4c69-a4de-9664bf61b22b could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:06.916578 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-34e70d51-b715-4679-9f30-1109c62775cd tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b" status: 404 len: 111 microversion: 2.1 time: 0.035024 Jun 23 12:03:06.917639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 628/1158] 10.222.0.67 () {58 vars in 1250 bytes} [Thu Jun 23 12:03:06 2022] GET /compute/v2.1/os-snapshots/9d5efd30-68f5-4c69-a4de-9664bf61b22b => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:03:06.919589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-40f2a98e-b804-4403-8b54-bc4f757217d9 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae5f79a60>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:06.982806 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-40f2a98e-b804-4403-8b54-bc4f757217d9 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf" status: 202 len: 0 microversion: 2.1 time: 0.067358 Jun 23 12:03:06.983383 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 531/1159] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 12:03:06 2022] DELETE /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:03:06.996443 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-03081b18-6e85-4c99-929b-a474f4ea3394 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae5fb2790>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:07.056011 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-03081b18-6e85-4c99-929b-a474f4ea3394 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf" status: 200 len: 345 microversion: 2.1 time: 0.068362 Jun 23 12:03:07.057017 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 629/1160] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:03:06 2022] GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf => generated 345 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:03:08.071311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-47593ed2-3f82-4f05-bea4-191f3e2b2254 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae615b700>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:08.101840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-47593ed2-3f82-4f05-bea4-191f3e2b2254 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] HTTP exception thrown: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-47593ed2-3f82-4f05-bea4-191f3e2b2254 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Request method failure captured: Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf HTTP/1.1 Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFZ0OAzr9peG0r_MXBJipnpcCrhH0_fYE4RobFbg3Lw-KrBhcXzM8UpgkhQbiePTJbkgUXkLqyQ4y21dx-quFuIMNvDAKKd0eWAm_fWgoQJsvUQB-faeaNnMIbLffs9DCCemTu64qBlYngCAq3Vz-sV6LZ0BYmj-kcHm7jfUv6Hwec8 Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:03:08.112541 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 07d02953330044ce8d0c9d65591d0521 Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '05fe4ef0-9eb2-4b59-8d97-81df085699bf'} Jun 23 12:03:08.113997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. (HTTP 404) (Request-ID: req-2e2e5b8f-82c3-42a2-b7d9-1498e7efb07f) Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.114974 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:08.116405 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 12:03:08.117607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-47593ed2-3f82-4f05-bea4-191f3e2b2254 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Returning 404 to user: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-47593ed2-3f82-4f05-bea4-191f3e2b2254 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf" status: 404 len: 109 microversion: 2.1 time: 0.048001 Jun 23 12:03:08.118797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 532/1161] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:03:08 2022] GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf => generated 109 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:03:08.129519 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-69105cc0-99ce-41e7-8822-9f007cedc2f7 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae5f0f790>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:08.164651 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-69105cc0-99ce-41e7-8822-9f007cedc2f7 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] HTTP exception thrown: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-69105cc0-99ce-41e7-8822-9f007cedc2f7 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Request method failure captured: Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: DELETE /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf HTTP/1.1 Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFZ0OAzr9peG0r_MXBJipnpcCrhH0_fYE4RobFbg3Lw-KrBhcXzM8UpgkhQbiePTJbkgUXkLqyQ4y21dx-quFuIMNvDAKKd0eWAm_fWgoQJsvUQB-faeaNnMIbLffs9DCCemTu64qBlYngCAq3Vz-sV6LZ0BYmj-kcHm7jfUv6Hwec8 Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:08.166652 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 07d02953330044ce8d0c9d65591d0521 Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '05fe4ef0-9eb2-4b59-8d97-81df085699bf'} Jun 23 12:03:08.168318 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. (HTTP 404) (Request-ID: req-86bdd21b-b325-45bb-a51b-bf412329ac60) Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.169302 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 12:03:08.170482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 12:03:08.171658 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-69105cc0-99ce-41e7-8822-9f007cedc2f7 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Returning 404 to user: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:08.172934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-69105cc0-99ce-41e7-8822-9f007cedc2f7 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf" status: 404 len: 109 microversion: 2.1 time: 0.042789 Jun 23 12:03:08.173773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 630/1162] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 12:03:08 2022] DELETE /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:03:08.179250 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5bd85f94-c81a-401a-a6a9-d6f2313374e8 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Calling method '.version_select at 0x7f3ae63d7af0>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:08.208873 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-5bd85f94-c81a-401a-a6a9-d6f2313374e8 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] HTTP exception thrown: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5bd85f94-c81a-401a-a6a9-d6f2313374e8 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Request method failure captured: Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf HTTP/1.1 Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFZ0OAzr9peG0r_MXBJipnpcCrhH0_fYE4RobFbg3Lw-KrBhcXzM8UpgkhQbiePTJbkgUXkLqyQ4y21dx-quFuIMNvDAKKd0eWAm_fWgoQJsvUQB-faeaNnMIbLffs9DCCemTu64qBlYngCAq3Vz-sV6LZ0BYmj-kcHm7jfUv6Hwec8 Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:03:08.210816 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_860087fb6db04cd0b5ee816816a5a3fa"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 860087fb6db04cd0b5ee816816a5a3fa Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1492486432 Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 07d02953330044ce8d0c9d65591d0521 Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1492486432-project Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '05fe4ef0-9eb2-4b59-8d97-81df085699bf'} Jun 23 12:03:08.212464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. (HTTP 404) (Request-ID: req-67ec3a85-63ae-46a8-b062-f5ba3d721a4b) Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.213518 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:08.215572 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 12:03:08.216989 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5bd85f94-c81a-401a-a6a9-d6f2313374e8 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] Returning 404 to user: Volume 05fe4ef0-9eb2-4b59-8d97-81df085699bf could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5bd85f94-c81a-401a-a6a9-d6f2313374e8 tempest-VolumesSnapshotsTestJSON-1492486432 tempest-VolumesSnapshotsTestJSON-1492486432-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf" status: 404 len: 109 microversion: 2.1 time: 0.037711 Jun 23 12:03:08.218352 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 533/1163] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:03:08 2022] GET /compute/v2.1/os-volumes/05fe4ef0-9eb2-4b59-8d97-81df085699bf => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:03:15.267390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=54,nova_api:DELETE=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:15.268772 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=28 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:15.273452 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4f041a12-74a4-478c-b4cc-9aaa893793c8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:15.274404 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4f041a12-74a4-478c-b4cc-9aaa893793c8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:15.282545 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f041a12-74a4-478c-b4cc-9aaa893793c8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:15.283002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f041a12-74a4-478c-b4cc-9aaa893793c8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:15.283789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f041a12-74a4-478c-b4cc-9aaa893793c8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:15.284383 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4f041a12-74a4-478c-b4cc-9aaa893793c8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:15.316774 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4f041a12-74a4-478c-b4cc-9aaa893793c8 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050685 Jun 23 12:03:15.317424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 631/1164] 10.222.0.67 () {60 vars in 1342 bytes} [Thu Jun 23 12:03:15 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:03:15.381088 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:15.381589 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:15.384726 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=50,nova_api:UPDATE=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:15.385558 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=45 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:03:15.390411 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:15.391333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:15.392106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:15.392710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:15.419448 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:03:15.497534 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fd1d990c-4eb8-4ce4-a013-0d6df69ce34b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 204 len: 0 microversion: 2.20 time: 0.119740 Jun 23 12:03:15.498602 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 534/1165] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 23 12:03:15 2022] DELETE /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 12:03:15.506679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:15.507470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:15.513615 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:15.514212 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:15.515122 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:15.515685 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:15.649065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:15.657690 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:15.659219 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:15.660403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e47528a1-0529-4d0a-83fa-6641c1e7fa38 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.157633 Jun 23 12:03:15.660998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 632/1166] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:15 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:03:16.680414 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:16.681191 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:16.688277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:16.688749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:16.689532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:16.689960 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:16.830218 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:16.838221 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:16.839954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:16.841157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2773d22f-35f0-4982-af05-77d5c5fcaf0b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1725 microversion: 2.20 time: 0.165680 Jun 23 12:03:16.841712 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 535/1167] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:16 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:03:17.796277 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-e5b93c70-6d5c-43b0-bf13-8f23b490cb11 req-c70ab056-597e-433f-952f-37743c4b9205 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bd3c7247-2686-47a7-96dc-7ffbbe7e7c62", "name": "network-vif-deleted", "tag": "b3a6b734-e0ed-4bdf-9b35-b9b65ed45592"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:03:17.807995 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-e5b93c70-6d5c-43b0-bf13-8f23b490cb11 req-c70ab056-597e-433f-952f-37743c4b9205 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:17.809088 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-e5b93c70-6d5c-43b0-bf13-8f23b490cb11 req-c70ab056-597e-433f-952f-37743c4b9205 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:17.820737 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-e5b93c70-6d5c-43b0-bf13-8f23b490cb11 req-c70ab056-597e-433f-952f-37743c4b9205 service nova] Creating event network-vif-deleted:b3a6b734-e0ed-4bdf-9b35-b9b65ed45592 for instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 on hv-cinder-82660 Jun 23 12:03:17.826025 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-e5b93c70-6d5c-43b0-bf13-8f23b490cb11 req-c70ab056-597e-433f-952f-37743c4b9205 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035121 Jun 23 12:03:17.826715 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 633/1168] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:03:17 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:03:17.860697 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:17.861930 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:17.871283 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:17.871994 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:17.873116 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:17.873750 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:17.949029 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:17.959543 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:17.961413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:17.962934 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c4c22b69-26d6-48d2-85df-ba44f33b0d1b tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1657 microversion: 2.20 time: 0.106202 Jun 23 12:03:17.964828 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 536/1169] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:17 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1657 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:03:18.982650 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:18.983346 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:18.990121 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:18.990566 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:18.991914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:18.991914 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:19.055018 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:19.063509 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:19.065076 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:19.066213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-36a84bb7-73c9-45df-8d1f-e8fdbd3c9ff6 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1367 microversion: 2.20 time: 0.087872 Jun 23 12:03:19.066773 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 634/1170] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:18 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1367 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:03:20.089394 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:20.090600 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:20.098618 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:20.099213 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:20.100156 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:20.100877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:20.159079 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:20.160369 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:20.160950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.objects.instance [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lazy-loading 'fault' on Instance uuid bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 {{(pid=117747) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 23 12:03:20.234349 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:20.244491 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:20.246709 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'ebfb5a6c657a4fd592ff9e67348627eb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd211354c655b469491d235e5507e61ba', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:03:20.248192 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c9df9ee3-43d0-4f57-8422-32687a52b681 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 200 len: 1372 microversion: 2.20 time: 0.165025 Jun 23 12:03:20.259654 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 537/1171] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:20 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 1372 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 23 12:03:21.267230 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:21.267842 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:21.274453 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:21.274909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:21.275699 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:21.276104 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:21.289733 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] HTTP exception thrown: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Request method failure captured: Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 HTTP/1.1 Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSPMNO3Oaei6AGjncUJ3c2lTpmCOLsa8mHhLotO7dEO1X8Zw_3e8xtpfqhkKshnrgmMz23rfj-w6Rd6OYvNtZUT5ultiuIVrPrL9Ak43OpoaCyXjKWIJxdRlkIs0B_RU3bMJkbqOc4dCIl4VujqlLDmtOBzzxhT-uKuuzja53erJ2w Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:21.291361 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d211354c655b469491d235e5507e61ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d211354c655b469491d235e5507e61ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: ebfb5a6c657a4fd592ff9e67348627eb Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:21.293876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'bd3c7247-2686-47a7-96dc-7ffbbe7e7c62'} Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:21.294864 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:21.296368 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:21.297829 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Returning 404 to user: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:21.297829 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c877a7b3-a8cf-41b4-a457-512210481e4f tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 404 len: 111 microversion: 2.20 time: 0.029542 Jun 23 12:03:21.297829 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 635/1172] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:21 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:21.302605 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-19db8ce9-7e4a-4e6d-b29f-12ce64df248a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '.version_select at 0x7f3aea759280>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:21.319631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-19db8ce9-7e4a-4e6d-b29f-12ce64df248a tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723804697" status: 204 len: 0 microversion: 2.20 time: 0.021065 Jun 23 12:03:21.320212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 538/1173] 10.222.0.67 () {60 vars in 1261 bytes} [Thu Jun 23 12:03:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1723804697 => generated 0 bytes in 22 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 23 12:03:23.065586 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:23.066095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:23.072628 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:23.073117 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:23.073896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:23.073896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:23.092449 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] HTTP exception thrown: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Request method failure captured: Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: DELETE /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 HTTP/1.1 Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSPMNO3Oaei6AGjncUJ3c2lTpmCOLsa8mHhLotO7dEO1X8Zw_3e8xtpfqhkKshnrgmMz23rfj-w6Rd6OYvNtZUT5ultiuIVrPrL9Ak43OpoaCyXjKWIJxdRlkIs0B_RU3bMJkbqOc4dCIl4VujqlLDmtOBzzxhT-uKuuzja53erJ2w Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:23.094050 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d211354c655b469491d235e5507e61ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d211354c655b469491d235e5507e61ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: ebfb5a6c657a4fd592ff9e67348627eb Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.095765 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'bd3c7247-2686-47a7-96dc-7ffbbe7e7c62'} Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:23.097634 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.099110 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.100610 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Returning 404 to user: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:23.100610 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6aada798-b3ed-45e0-907a-21c396b6c883 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 404 len: 111 microversion: 2.20 time: 0.033696 Jun 23 12:03:23.100610 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 636/1174] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 23 12:03:23 2022] DELETE /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:23.106607 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:23.107328 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: bd3c7247-2686-47a7-96dc-7ffbbe7e7c62] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:23.114426 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:23.114885 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:23.115717 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:23.116158 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:23.130292 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] HTTP exception thrown: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Request method failure captured: Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 HTTP/1.1 Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSPMNO3Oaei6AGjncUJ3c2lTpmCOLsa8mHhLotO7dEO1X8Zw_3e8xtpfqhkKshnrgmMz23rfj-w6Rd6OYvNtZUT5ultiuIVrPrL9Ak43OpoaCyXjKWIJxdRlkIs0B_RU3bMJkbqOc4dCIl4VujqlLDmtOBzzxhT-uKuuzja53erJ2w Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:03:23.131950 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d211354c655b469491d235e5507e61ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d211354c655b469491d235e5507e61ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: ebfb5a6c657a4fd592ff9e67348627eb Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.133456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'bd3c7247-2686-47a7-96dc-7ffbbe7e7c62'} Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:23.134562 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. Jun 23 12:03:23.136182 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:23.138179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Returning 404 to user: Instance bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:23.138179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-2cf02f13-e76b-480b-9f47-6d0dc0020904 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62" status: 404 len: 111 microversion: 2.20 time: 0.031636 Jun 23 12:03:23.138179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 539/1175] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:23 2022] GET /compute/v2.1/servers/bd3c7247-2686-47a7-96dc-7ffbbe7e7c62 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:24.289885 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:24.290389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:24.297647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:24.298210 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:24.298988 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:24.299426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:24.314282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] HTTP exception thrown: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Request method failure captured: Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: DELETE /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 HTTP/1.1 Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFSPMNO3Oaei6AGjncUJ3c2lTpmCOLsa8mHhLotO7dEO1X8Zw_3e8xtpfqhkKshnrgmMz23rfj-w6Rd6OYvNtZUT5ultiuIVrPrL9Ak43OpoaCyXjKWIJxdRlkIs0B_RU3bMJkbqOc4dCIl4VujqlLDmtOBzzxhT-uKuuzja53erJ2w Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:24.315851 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d211354c655b469491d235e5507e61ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d211354c655b469491d235e5507e61ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: ebfb5a6c657a4fd592ff9e67348627eb Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.317521 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'e19ec4d3-4ce1-4fbd-81ea-025a5c724421'} Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:24.318380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.319708 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.322344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Returning 404 to user: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:24.322344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-6796cecd-d1e0-4559-9901-3b5905f4f7d1 tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 404 len: 111 microversion: 2.20 time: 0.031327 Jun 23 12:03:24.322344 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 637/1176] 10.222.0.67 () {60 vars in 1279 bytes} [Thu Jun 23 12:03:24 2022] DELETE /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:24.326771 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:24.327387 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] [instance: e19ec4d3-4ce1-4fbd-81ea-025a5c724421] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:03:24.333539 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:24.333986 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:24.334749 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:03:24.335178 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:03:24.349153 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] HTTP exception thrown: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Request method failure captured: Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 HTTP/1.1 Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFSPMNO3Oaei6AGjncUJ3c2lTpmCOLsa8mHhLotO7dEO1X8Zw_3e8xtpfqhkKshnrgmMz23rfj-w6Rd6OYvNtZUT5ultiuIVrPrL9Ak43OpoaCyXjKWIJxdRlkIs0B_RU3bMJkbqOc4dCIl4VujqlLDmtOBzzxhT-uKuuzja53erJ2w Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Openstack-Nova-Api-Version: 2.20 Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:03:24.350651 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/d211354c655b469491d235e5507e61ba"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/d211354c655b469491d235e5507e61ba"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_d211354c655b469491d235e5507e61ba"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: d211354c655b469491d235e5507e61ba Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1224111289 Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: ebfb5a6c657a4fd592ff9e67348627eb Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1224111289-project Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.352332 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'e19ec4d3-4ce1-4fbd-81ea-025a5c724421'} Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:24.353319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. Jun 23 12:03:24.354780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:24.356042 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] Returning 404 to user: Instance e19ec4d3-4ce1-4fbd-81ea-025a5c724421 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:24.356042 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-49b8ff01-9584-4f50-9c7e-5d1dc76dc0ee tempest-AttachVolumeShelveTestJSON-1224111289 tempest-AttachVolumeShelveTestJSON-1224111289-project] 10.222.0.67 "GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421" status: 404 len: 111 microversion: 2.20 time: 0.029973 Jun 23 12:03:24.356042 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 540/1177] 10.222.0.67 () {60 vars in 1276 bytes} [Thu Jun 23 12:03:24 2022] GET /compute/v2.1/servers/e19ec4d3-4ce1-4fbd-81ea-025a5c724421 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:29.205151 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b2039a59-980e-4941-972d-e75c630a86de tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Action: 'create', calling method: .version_select at 0x7f3ae60e01f0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-404149462", "metadata": {"Type": "work"}}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b2039a59-980e-4941-972d-e75c630a86de tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Request method failure captured: Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 121 Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFaRT5iZvcsxAv4gvCf2XyUtK6R-IsW6ewuGOpaJwlWpainSAhBmKirW3wb_oZNEwoyobapoOMaHqLkTfV8leCYdgPwRGM5wwUh9lZlwEzi4lq_OAKmbLZkOtDCo99eDp7XOtvMf1vGGtsfHSlQNIkhbN23cpn7UvEqCD1mKb6tTYEw Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:29.229540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0a78150292244570817a5eb92674adff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0a78150292244570817a5eb92674adff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 666354fb1f144814b8b5b462005b7c55 Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-404149462", "metadata": {"Type": "work"}}} Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: Jun 23 12:03:29.231865 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-404149462', 'metadata': {'Type': 'work'}}}} Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise error Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi '#$%' Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:29.232923 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 12:03:29.234594 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 12:03:29.236012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 23 12:03:29.236012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.236012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b2039a59-980e-4941-972d-e75c630a86de tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:29.236012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b2039a59-980e-4941-972d-e75c630a86de tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.145987 Jun 23 12:03:29.236012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 638/1178] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 23 12:03:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 147 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:29.241265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa172b33-20b6-4665-9b55-6bfb3e535c9c tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Action: 'create', calling method: .version_select at 0x7f3ae60725e0>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-136298998", "metadata": {"Type": "work"}}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa172b33-20b6-4665-9b55-6bfb3e535c9c tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Request method failure captured: Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 119 Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFaRT5iZvcsxAv4gvCf2XyUtK6R-IsW6ewuGOpaJwlWpainSAhBmKirW3wb_oZNEwoyobapoOMaHqLkTfV8leCYdgPwRGM5wwUh9lZlwEzi4lq_OAKmbLZkOtDCo99eDp7XOtvMf1vGGtsfHSlQNIkhbN23cpn7UvEqCD1mKb6tTYEw Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:03:29.244495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0a78150292244570817a5eb92674adff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0a78150292244570817a5eb92674adff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 666354fb1f144814b8b5b462005b7c55 Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-136298998", "metadata": {"Type": "work"}}} Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: Jun 23 12:03:29.246157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-136298998', 'metadata': {'Type': 'work'}}}} Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise error Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi '0' Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:29.247296 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 12:03:29.249125 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 12:03:29.250367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 23 12:03:29.250367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.250367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fa172b33-20b6-4665-9b55-6bfb3e535c9c tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:29.250367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fa172b33-20b6-4665-9b55-6bfb3e535c9c tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.008579 Jun 23 12:03:29.250367 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 541/1179] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 23 12:03:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:29.255782 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-98579005-91f3-4235-950a-31647d5ff5f3 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Action: 'create', calling method: .version_select at 0x7f3aea669670>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1196553678", "metadata": {"Type": "work"}}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-98579005-91f3-4235-950a-31647d5ff5f3 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Request method failure captured: Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 119 Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFaRT5iZvcsxAv4gvCf2XyUtK6R-IsW6ewuGOpaJwlWpainSAhBmKirW3wb_oZNEwoyobapoOMaHqLkTfV8leCYdgPwRGM5wwUh9lZlwEzi4lq_OAKmbLZkOtDCo99eDp7XOtvMf1vGGtsfHSlQNIkhbN23cpn7UvEqCD1mKb6tTYEw Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:29.258085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0a78150292244570817a5eb92674adff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0a78150292244570817a5eb92674adff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 666354fb1f144814b8b5b462005b7c55 Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-1196553678", "metadata": {"Type": "work"}}} Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: Jun 23 12:03:29.259661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-1196553678', 'metadata': {'Type': 'work'}}}} Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise error Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi '' Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:29.260731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 23 12:03:29.262396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 23 12:03:29.263668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 23 12:03:29.263668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.263668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-98579005-91f3-4235-950a-31647d5ff5f3 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:29.263668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-98579005-91f3-4235-950a-31647d5ff5f3 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.007586 Jun 23 12:03:29.263668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 639/1180] 10.222.0.67 () {60 vars in 1155 bytes} [Thu Jun 23 12:03:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 9 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 23 12:03:29.269133 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-19023f40-73d1-4fb5-8382-596651232cf2 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Calling method '.version_select at 0x7f3ae610d8b0>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:29.298954 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-19023f40-73d1-4fb5-8382-596651232cf2 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] HTTP exception thrown: Volume tempest-invalid-485641251 could not be found. Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-19023f40-73d1-4fb5-8382-596651232cf2 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Request method failure captured: Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-485641251 HTTP/1.1 Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFaRT5iZvcsxAv4gvCf2XyUtK6R-IsW6ewuGOpaJwlWpainSAhBmKirW3wb_oZNEwoyobapoOMaHqLkTfV8leCYdgPwRGM5wwUh9lZlwEzi4lq_OAKmbLZkOtDCo99eDp7XOtvMf1vGGtsfHSlQNIkhbN23cpn7UvEqCD1mKb6tTYEw Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:03:29.301186 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0a78150292244570817a5eb92674adff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0a78150292244570817a5eb92674adff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 666354fb1f144814b8b5b462005b7c55 Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Volume tempest-invalid-485641251 could not be found. Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'tempest-invalid-485641251'} Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:29.302889 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-485641251 could not be found. (HTTP 404) (Request-ID: req-d46050fe-d7bb-4acf-8f9e-71f015c07f25) Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.303982 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 12:03:29.305608 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-485641251 could not be found. Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:29.306978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-485641251 could not be found. Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-485641251 could not be found. Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-19023f40-73d1-4fb5-8382-596651232cf2 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Returning 404 to user: Volume tempest-invalid-485641251 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-19023f40-73d1-4fb5-8382-596651232cf2 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/tempest-invalid-485641251" status: 404 len: 98 microversion: 2.1 time: 0.037841 Jun 23 12:03:29.308622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 542/1181] 10.222.0.67 () {58 vars in 1214 bytes} [Thu Jun 23 12:03:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-485641251 => generated 98 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 23 12:03:29.314240 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7810119c-b8bd-46d7-bab6-0e384ed80fb9 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004827 Jun 23 12:03:29.314739 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 640/1182] 10.222.0.67 () {58 vars in 1139 bytes} [Thu Jun 23 12:03:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 12:03:29.323177 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b3ecdf18-8cda-45a0-b825-9e5417e28a1b tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003702 Jun 23 12:03:29.323672 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 543/1183] 10.222.0.67 () {58 vars in 1136 bytes} [Thu Jun 23 12:03:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 23 12:03:29.331563 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fb30087e-b12d-4b61-a247-f98f232f8c94 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Calling method '.version_select at 0x7f3ae5f9b280>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:29.359836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-fb30087e-b12d-4b61-a247-f98f232f8c94 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] HTTP exception thrown: Volume 548d7cb7-85cb-4759-876e-2518f26ffbe7 could not be found. Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fb30087e-b12d-4b61-a247-f98f232f8c94 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Request method failure captured: Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: DELETE /compute/v2.1/os-volumes/548d7cb7-85cb-4759-876e-2518f26ffbe7 HTTP/1.1 Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFaRT5iZvcsxAv4gvCf2XyUtK6R-IsW6ewuGOpaJwlWpainSAhBmKirW3wb_oZNEwoyobapoOMaHqLkTfV8leCYdgPwRGM5wwUh9lZlwEzi4lq_OAKmbLZkOtDCo99eDp7XOtvMf1vGGtsfHSlQNIkhbN23cpn7UvEqCD1mKb6tTYEw Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:03:29.361839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0a78150292244570817a5eb92674adff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0a78150292244570817a5eb92674adff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 666354fb1f144814b8b5b462005b7c55 Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Volume 548d7cb7-85cb-4759-876e-2518f26ffbe7 could not be found. Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '548d7cb7-85cb-4759-876e-2518f26ffbe7'} Jun 23 12:03:29.363468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 548d7cb7-85cb-4759-876e-2518f26ffbe7 could not be found. (HTTP 404) (Request-ID: req-dcc162e3-4f34-4b50-afc6-722606cf294c) Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.364410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 23 12:03:29.365875 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 548d7cb7-85cb-4759-876e-2518f26ffbe7 could not be found. Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 23 12:03:29.367179 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 548d7cb7-85cb-4759-876e-2518f26ffbe7 could not be found. Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 548d7cb7-85cb-4759-876e-2518f26ffbe7 could not be found. Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-fb30087e-b12d-4b61-a247-f98f232f8c94 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Returning 404 to user: Volume 548d7cb7-85cb-4759-876e-2518f26ffbe7 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-fb30087e-b12d-4b61-a247-f98f232f8c94 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "DELETE /compute/v2.1/os-volumes/548d7cb7-85cb-4759-876e-2518f26ffbe7" status: 404 len: 109 microversion: 2.1 time: 0.035234 Jun 23 12:03:29.368475 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 641/1184] 10.222.0.67 () {58 vars in 1247 bytes} [Thu Jun 23 12:03:29 2022] DELETE /compute/v2.1/os-volumes/548d7cb7-85cb-4759-876e-2518f26ffbe7 => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:03:29.373441 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b8d410cd-f6ee-45a3-8a56-00dc084e89a8 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Calling method '.version_select at 0x7f3ae6193dc0>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:03:29.399305 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-b8d410cd-f6ee-45a3-8a56-00dc084e89a8 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] HTTP exception thrown: Volume 2b896134-0e39-4344-b8c4-bf29bc157756 could not be found. Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b8d410cd-f6ee-45a3-8a56-00dc084e89a8 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Request method failure captured: Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/os-volumes/2b896134-0e39-4344-b8c4-bf29bc157756 HTTP/1.1 Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFaRT5iZvcsxAv4gvCf2XyUtK6R-IsW6ewuGOpaJwlWpainSAhBmKirW3wb_oZNEwoyobapoOMaHqLkTfV8leCYdgPwRGM5wwUh9lZlwEzi4lq_OAKmbLZkOtDCo99eDp7XOtvMf1vGGtsfHSlQNIkhbN23cpn7UvEqCD1mKb6tTYEw Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:03:29.401285 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/0a78150292244570817a5eb92674adff"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/0a78150292244570817a5eb92674adff"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_0a78150292244570817a5eb92674adff"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: 0a78150292244570817a5eb92674adff Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-VolumesNegativeTest-12166592 Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 666354fb1f144814b8b5b462005b7c55 Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-VolumesNegativeTest-12166592-project Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Volume 2b896134-0e39-4344-b8c4-bf29bc157756 could not be found. Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '2b896134-0e39-4344-b8c4-bf29bc157756'} Jun 23 12:03:29.403437 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 2b896134-0e39-4344-b8c4-bf29bc157756 could not be found. (HTTP 404) (Request-ID: req-a31c134f-e97f-440f-89b4-8371d991019b) Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.404575 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 23 12:03:29.406145 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 2b896134-0e39-4344-b8c4-bf29bc157756 could not be found. Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 23 12:03:29.408427 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 2b896134-0e39-4344-b8c4-bf29bc157756 could not be found. Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 2b896134-0e39-4344-b8c4-bf29bc157756 could not be found. Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b8d410cd-f6ee-45a3-8a56-00dc084e89a8 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] Returning 404 to user: Volume 2b896134-0e39-4344-b8c4-bf29bc157756 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b8d410cd-f6ee-45a3-8a56-00dc084e89a8 tempest-VolumesNegativeTest-12166592 tempest-VolumesNegativeTest-12166592-project] 10.222.0.67 "GET /compute/v2.1/os-volumes/2b896134-0e39-4344-b8c4-bf29bc157756" status: 404 len: 109 microversion: 2.1 time: 0.034250 Jun 23 12:03:29.409856 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 544/1185] 10.222.0.67 () {58 vars in 1244 bytes} [Thu Jun 23 12:03:29 2022] GET /compute/v2.1/os-volumes/2b896134-0e39-4344-b8c4-bf29bc157756 => generated 109 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 23 12:04:21.845531 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=22,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:21.847024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:21.847821 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=38,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:21.848238 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:21.852091 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-f652027a-f54a-4743-8a59-102f2ea53ddc req-f70a6cec-210a-4b0f-bcaf-f24192edd9f6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9442b025-7b22-40c8-8f76-3a3379bf8e83", "tag": "4f655e92-f7d0-4eb3-aa0d-313d293bd617"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:04:21.852259 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=14 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:21.853081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=26 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:21.860268 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:21.861016 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:21.862092 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:21.862694 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:21.872826 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f652027a-f54a-4743-8a59-102f2ea53ddc req-f70a6cec-210a-4b0f-bcaf-f24192edd9f6 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:21.873220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f652027a-f54a-4743-8a59-102f2ea53ddc req-f70a6cec-210a-4b0f-bcaf-f24192edd9f6 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:21.896810 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-f652027a-f54a-4743-8a59-102f2ea53ddc req-f70a6cec-210a-4b0f-bcaf-f24192edd9f6 service nova] Creating event network-changed:4f655e92-f7d0-4eb3-aa0d-313d293bd617 for instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 on hv-cinder-82660 Jun 23 12:04:21.901904 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:04:21.902559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-f652027a-f54a-4743-8a59-102f2ea53ddc req-f70a6cec-210a-4b0f-bcaf-f24192edd9f6 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.058393 Jun 23 12:04:21.903878 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 545/1186] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:04:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:04:22.016065 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-9b6ca5eb-4057-4fd0-9899-b5d8ef132463 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "DELETE /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 204 len: 0 microversion: 2.1 time: 0.174189 Jun 23 12:04:22.022036 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 642/1187] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:04:21 2022] DELETE /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 0 bytes in 178 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:04:22.035782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:22.035782 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:22.038131 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:22.038833 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:22.040043 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:22.040647 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:22.230491 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:22.239260 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bb1d348f-2850-460c-9131-55d14af8b69d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.215479 Jun 23 12:04:22.239845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 546/1188] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:22 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:04:23.258582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:23.259389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:23.266390 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:23.267057 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:23.268035 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:23.268659 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:23.406838 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:23.414876 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-397f23ee-7daf-4d76-ae7f-7912d0b1db93 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1569 microversion: 2.1 time: 0.160540 Jun 23 12:04:23.415436 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 643/1189] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:23 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1569 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:04:24.354083 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-810430d0-1996-4d35-a188-87551275a5d1 req-72174b05-9ee8-43f7-88f3-099d90cb79a1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9442b025-7b22-40c8-8f76-3a3379bf8e83", "name": "network-vif-deleted", "tag": "4f655e92-f7d0-4eb3-aa0d-313d293bd617"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:04:24.364335 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-810430d0-1996-4d35-a188-87551275a5d1 req-72174b05-9ee8-43f7-88f3-099d90cb79a1 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:24.365154 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-810430d0-1996-4d35-a188-87551275a5d1 req-72174b05-9ee8-43f7-88f3-099d90cb79a1 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:24.379797 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-810430d0-1996-4d35-a188-87551275a5d1 req-72174b05-9ee8-43f7-88f3-099d90cb79a1 service nova] Creating event network-vif-deleted:4f655e92-f7d0-4eb3-aa0d-313d293bd617 for instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 on hv-cinder-82660 Jun 23 12:04:24.385500 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-810430d0-1996-4d35-a188-87551275a5d1 req-72174b05-9ee8-43f7-88f3-099d90cb79a1 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035374 Jun 23 12:04:24.386103 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 547/1190] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:04:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:04:24.433814 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:24.434424 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:24.441639 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:24.442094 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:24.443061 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:24.443488 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:24.530070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '62766b6eeb3d47beb5e3d056fb6d5d81', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'a2d3e44f4113405a9cd4e604aea9955b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:24.537741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1787cf32-a506-460d-9eaf-3bb134bea497 tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 200 len: 1220 microversion: 2.1 time: 0.107731 Jun 23 12:04:24.538479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 644/1191] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:24 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 1220 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:04:25.556932 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:25.561644 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] [instance: 9442b025-7b22-40c8-8f76-3a3379bf8e83] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:25.573381 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:25.576010 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:25.576837 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:25.577278 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:25.591884 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] HTTP exception thrown: Instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 could not be found. Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Request method failure captured: Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 HTTP/1.1 Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFWrT3J83ytGHyRrn1ppSKeOXdQan3DhTJp3MOlZvWLnAiNxOkFBYEqWoraO-pRpLCoIZCdmUf6xHzRV10gOLrnEpJ7UkWZDh3SwPOy3a8bjNsXjkTm6H7WMrZrQGSg2MFSRetQiGR1w-2zkVM-Gn0FUpP0q8_mBYFl-FCKikTDQoxA Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: a2d3e44f4113405a9cd4e604aea9955b Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-TestShelveInstance-1999365184 Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:04:25.596522 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2d3e44f4113405a9cd4e604aea9955b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/a2d3e44f4113405a9cd4e604aea9955b"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/a2d3e44f4113405a9cd4e604aea9955b"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_a2d3e44f4113405a9cd4e604aea9955b"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-TestShelveInstance-1999365184 Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: a2d3e44f4113405a9cd4e604aea9955b Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-TestShelveInstance-1999365184 Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-TestShelveInstance-1999365184-project Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 62766b6eeb3d47beb5e3d056fb6d5d81 Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-TestShelveInstance-1999365184-project Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 could not be found. Jun 23 12:04:25.598170 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '9442b025-7b22-40c8-8f76-3a3379bf8e83'} Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 could not be found. Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:04:25.599087 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 could not be found. Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 could not be found. Jun 23 12:04:25.600482 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:04:25.603151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Returning 404 to user: Instance 9442b025-7b22-40c8-8f76-3a3379bf8e83 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:04:25.603151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-37682684-0225-43df-adba-b0d7e86d6b4d tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83" status: 404 len: 111 microversion: 2.1 time: 0.047751 Jun 23 12:04:25.603151 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 548/1192] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:25 2022] GET /compute/v2.1/servers/9442b025-7b22-40c8-8f76-3a3379bf8e83 => generated 111 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:04:25.784440 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-826e04a0-0bd4-44b0-a0c9-d1f8070463bd tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] Calling method '.version_select at 0x7f3aea630550>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:25.815751 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-826e04a0-0bd4-44b0-a0c9-d1f8070463bd tempest-TestShelveInstance-1999365184 tempest-TestShelveInstance-1999365184-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1291048427" status: 202 len: 0 microversion: 2.1 time: 0.036721 Jun 23 12:04:25.820907 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 645/1193] 10.222.0.67 () {58 vars in 1253 bytes} [Thu Jun 23 12:04:25 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-1291048427 => generated 0 bytes in 43 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 23 12:04:36.948067 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=8 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:36.954669 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=12 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:37.176968 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7b43bdab-5b14-4bb4-95c7-c0fc334d56c8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Action: 'create', calling method: .version_select at 0x7f3ae62abdc0>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-220120090", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHX+6g8AI1/YXYcYn4xkkYZIYFauP+WPXuo3Wf3u1B45BNPVyZ3ho3ro8uY+2zz5qG3s32JAtHBB6nyZ9VFcisRS8RM3zX3md3VxYqU5R2GUnOw140R23+I3KdhjIwkAqg=="}} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:04:37.194534 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-7b43bdab-5b14-4bb4-95c7-c0fc334d56c8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for project c41820d2b5eb4dedb313bcef88259676. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:04:37.199156 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.quota [None req-7b43bdab-5b14-4bb4-95c7-c0fc334d56c8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for user 8731c4e543814bcf80075cd315a7b7ff and project c41820d2b5eb4dedb313bcef88259676. Resources: {'key_pairs'} {{(pid=117747) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:04:37.225262 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7b43bdab-5b14-4bb4-95c7-c0fc334d56c8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.290612 Jun 23 12:04:37.225873 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 549/1194] 10.222.0.67 () {60 vars in 1158 bytes} [Thu Jun 23 12:04:36 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:04:53.514970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1326465200", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-220120090", "security_groups": [{"name": "tempest-secgroup-smoke-642463158"}], "block_device_mapping_v2": [{"uuid": "86747eba-38c9-4eeb-b493-2da1186d366f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afd3f766-cce7-48e3-b8ae-4e4ead512081"}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:04:53.524032 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=26,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:53.525002 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=14,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:53.732456 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] validate_networks() for [('afd3f766-cce7-48e3-b8ae-4e4ead512081', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:04:54.094759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:04:54.095189 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:04:54.095662 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:04:54.096072 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:04:54.096484 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:04:54.105405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:54.105849 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:54.106644 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:54.107081 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:54.123450 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for project c41820d2b5eb4dedb313bcef88259676. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:04:54.127564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for user 8731c4e543814bcf80075cd315a7b7ff and project c41820d2b5eb4dedb313bcef88259676. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:04:54.184621 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:04:54.186753 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86747eba-38c9-4eeb-b493-2da1186d366f',volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:04:54.311490 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-292d4000-4bc3-4c22-bfbe-b91f3b4ca0e5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.800593 Jun 23 12:04:54.312227 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 646/1195] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 12:04:53 2022] POST /compute/v2.1/servers => generated 405 bytes in 802 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 12:04:54.323423 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-fde9337e-b64f-4271-a1a1-da9ff51806d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:54.324053 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-fde9337e-b64f-4271-a1a1-da9ff51806d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:54.326761 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=4 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:54.327404 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=11,nova_api:INSERT=1 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:04:54.493424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-fde9337e-b64f-4271-a1a1-da9ff51806d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:54.500099 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-fde9337e-b64f-4271-a1a1-da9ff51806d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1094 microversion: 2.1 time: 0.180607 Jun 23 12:04:54.500659 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 550/1196] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:54 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1094 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:04:54.725711 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:04:54.725931 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Thu Jun 23 12:04:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:04:55.517649 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:55.518367 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:55.527263 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:55.527718 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:55.528498 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:55.528971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:55.592396 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:55.599827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1f51a8cb-f136-4735-9339-bbd98b661979 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1210 microversion: 2.1 time: 0.086194 Jun 23 12:04:55.600458 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 647/1197] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:55 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1210 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:04:56.616617 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:56.617254 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:56.624443 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:56.624864 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:56.625640 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:56.626081 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:56.859436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:56.867755 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-07b39731-c922-4b31-84b9-ebd7721ca3ea tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.254889 Jun 23 12:04:56.872495 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 551/1198] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:56 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:04:57.007506 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-13c660e6-7cae-460b-b1f9-39cf9e90c389 req-edd02da5-9108-482e-8512-6d5d0c9ecc40 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e72538-8ac4-495f-a9c1-b3e80dedede6", "tag": "1525e4e0-7c8b-4fcb-8bbc-bede3d396aac"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:04:57.018090 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-13c660e6-7cae-460b-b1f9-39cf9e90c389 req-edd02da5-9108-482e-8512-6d5d0c9ecc40 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:57.019713 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-13c660e6-7cae-460b-b1f9-39cf9e90c389 req-edd02da5-9108-482e-8512-6d5d0c9ecc40 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:57.043120 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-13c660e6-7cae-460b-b1f9-39cf9e90c389 req-edd02da5-9108-482e-8512-6d5d0c9ecc40 service nova] Creating event network-changed:1525e4e0-7c8b-4fcb-8bbc-bede3d396aac for instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 on hv-cinder-82660 Jun 23 12:04:57.048354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-13c660e6-7cae-460b-b1f9-39cf9e90c389 req-edd02da5-9108-482e-8512-6d5d0c9ecc40 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047341 Jun 23 12:04:57.049186 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 648/1199] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:04:56 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:04:57.885040 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:57.885668 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:57.892196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:57.892658 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:57.893465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:57.893903 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:58.108634 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:58.116316 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7e976e3c-1d42-4762-a30b-2f8f91fc1fa4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.235153 Jun 23 12:04:58.116926 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 552/1200] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:57 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:04:59.133685 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:04:59.134473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:04:59.142434 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:59.142882 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:59.143641 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:04:59.144064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:04:59.274310 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:04:59.281858 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-78a7b47e-0f3c-4076-b4b2-3f1504894f03 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.152452 Jun 23 12:04:59.282411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 649/1201] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:04:59 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:00.298420 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:00.299035 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:00.306304 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:00.306751 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:00.307512 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:00.307944 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:00.436415 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:00.444604 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-b8582272-ddf9-4f1d-bc99-8f802231e0aa tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.149412 Jun 23 12:05:00.445200 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 553/1202] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:00 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:01.461407 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:01.461970 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:01.468414 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:01.468928 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:01.469757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:01.470256 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:01.603858 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:01.611445 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ed0b0356-49bf-416d-b7cf-249b73475916 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.153995 Jun 23 12:05:01.612019 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 650/1203] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:01 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:02.628068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:02.628726 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:02.634886 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:02.635339 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:02.636097 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:02.636533 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:02.770672 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:02.778837 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5dba32fc-fe9a-476e-b957-a51578eb297b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.154640 Jun 23 12:05:02.779397 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 554/1204] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:02 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:03.795333 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:03.795946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:03.802855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:03.803904 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:03.804664 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:03.805125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:03.934764 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:03.942170 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-311fa979-2749-4752-8a27-4631cf2c8666 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.150718 Jun 23 12:05:03.942768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 651/1205] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:03 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:04.958884 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:04.959501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:04.961888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:04.967619 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:04.968068 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:04.968882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:04.969320 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:05.099274 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:05.107355 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-18c76a60-4da9-4e0d-8c9a-fd480142871e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.152304 Jun 23 12:05:05.107919 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 555/1206] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:04 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:06.124030 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:06.124618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:06.126710 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:06.127577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=6 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:05:06.134590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:06.135047 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:06.135822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:06.136261 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:06.274775 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:06.282199 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3e701270-b443-4dfe-ac2c-ee177e89eeb3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.162078 Jun 23 12:05:06.282769 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 652/1207] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:06 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:06.588559 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-c407fbea-0a9a-4922-97f3-cba893849cda req-0260ccd9-3e97-49a3-99f0-d7256af959ca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e72538-8ac4-495f-a9c1-b3e80dedede6", "name": "network-vif-plugged", "status": "completed", "tag": "1525e4e0-7c8b-4fcb-8bbc-bede3d396aac"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:05:06.597632 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c407fbea-0a9a-4922-97f3-cba893849cda req-0260ccd9-3e97-49a3-99f0-d7256af959ca service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:06.598345 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c407fbea-0a9a-4922-97f3-cba893849cda req-0260ccd9-3e97-49a3-99f0-d7256af959ca service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:06.610631 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-c407fbea-0a9a-4922-97f3-cba893849cda req-0260ccd9-3e97-49a3-99f0-d7256af959ca service nova] Creating event network-vif-plugged:1525e4e0-7c8b-4fcb-8bbc-bede3d396aac for instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 on hv-cinder-82660 Jun 23 12:05:06.615722 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-c407fbea-0a9a-4922-97f3-cba893849cda req-0260ccd9-3e97-49a3-99f0-d7256af959ca service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030899 Jun 23 12:05:06.617154 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 556/1208] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:05:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:05:07.298759 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:07.299403 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:07.306731 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:07.307180 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:07.307943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:07.308380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:07.438039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:07.445618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-bcc24f4a-f276-4207-98ab-176a9d98b09f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1265 microversion: 2.1 time: 0.150680 Jun 23 12:05:07.446178 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 653/1209] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:07 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:08.463346 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:08.464049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:08.470817 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:08.471267 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:08.472037 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:08.472477 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:08.603334 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:08.611032 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4cd6287e-f4a2-4001-bdec-87d7efb254d8 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1452 microversion: 2.1 time: 0.152436 Jun 23 12:05:08.611613 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 557/1210] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:08 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1452 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:08.627183 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:05:08.627790 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:05:08.634228 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:08.634672 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:08.635423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:08.635855 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:08.765378 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:05:08.772929 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-e9a33d90-0643-4f58-aabf-fa35d75d848d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1452 microversion: 2.1 time: 0.149479 Jun 23 12:05:08.775612 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 654/1211] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:05:08 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:05:10.692698 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-982665fe-5806-4823-83e7-c92c274cafe8 req-0a610078-5a9b-4c69-a03b-9a8c02bc0ea7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "81e72538-8ac4-495f-a9c1-b3e80dedede6", "tag": "1525e4e0-7c8b-4fcb-8bbc-bede3d396aac"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:05:10.703050 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-982665fe-5806-4823-83e7-c92c274cafe8 req-0a610078-5a9b-4c69-a03b-9a8c02bc0ea7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:05:10.703498 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-982665fe-5806-4823-83e7-c92c274cafe8 req-0a610078-5a9b-4c69-a03b-9a8c02bc0ea7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:05:10.715532 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-982665fe-5806-4823-83e7-c92c274cafe8 req-0a610078-5a9b-4c69-a03b-9a8c02bc0ea7 service nova] Creating event network-changed:1525e4e0-7c8b-4fcb-8bbc-bede3d396aac for instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 on hv-cinder-82660 Jun 23 12:05:10.720452 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-982665fe-5806-4823-83e7-c92c274cafe8 req-0a610078-5a9b-4c69-a03b-9a8c02bc0ea7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031448 Jun 23 12:05:10.721279 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 558/1212] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:07:07.918827 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR oslo.messaging._drivers.impl_rabbit [-] [554724fd-967d-4c7f-a2e5-3bfa411a1a7a] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 23 12:07:07.919530 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=31,nova_api:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:07.920295 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=46 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:07.925132 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:07.925637 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:07.934479 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:07.934932 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:07.935706 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:07.936145 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:07.961115 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Going to try to terminate instance {{(pid=117746) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:07:08.039678 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-994fe5fd-2c7c-4a5d-9b21-af7f4bf5c928 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "DELETE /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 204 len: 0 microversion: 2.1 time: 0.122882 Jun 23 12:07:08.040463 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 655/1213] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:07:07 2022] DELETE /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:07:08.047196 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR oslo.messaging._drivers.impl_rabbit [-] [15d1a892-dc49-4e7d-b9ef-7b9704ebd821] AMQP server on 10.222.0.67:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Jun 23 12:07:08.048337 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=20 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:08.049364 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=40 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:08.054137 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:08.054845 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:08.062879 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:08.063327 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:08.064113 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:08.064548 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:08.203874 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:08.211430 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-82131c0f-28d6-44c5-9e19-75fdef154645 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1576 microversion: 2.1 time: 0.166479 Jun 23 12:07:08.211991 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 559/1214] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:08 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1576 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 23 12:07:09.229389 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:09.230095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:09.238299 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:09.238772 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:09.239540 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:09.239967 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:09.245727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO oslo.messaging._drivers.impl_rabbit [-] [554724fd-967d-4c7f-a2e5-3bfa411a1a7a] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57300. Jun 23 12:07:09.383075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:09.390910 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-57c53a47-8711-49c6-8ebb-bca34ac9bb6c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1576 microversion: 2.1 time: 0.165909 Jun 23 12:07:09.391480 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 656/1215] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:09 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1576 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:10.410341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:10.410958 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:10.419272 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:10.419730 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:10.420517 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:10.421164 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:10.441766 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] [15d1a892-dc49-4e7d-b9ef-7b9704ebd821] Reconnected to AMQP server on 10.222.0.67:5672 via [amqp] client with port 57306. Jun 23 12:07:10.488890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:10.497076 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-d40e384b-660e-4bb0-b977-c3e6f29509d4 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 200 len: 1509 microversion: 2.1 time: 0.090704 Jun 23 12:07:10.497643 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 560/1216] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:10 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 1509 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:10.820467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-f5ba3f64-6953-4bab-954f-5700671b6812 req-37a4431f-235f-4bd5-9588-d81c811f7595 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "81e72538-8ac4-495f-a9c1-b3e80dedede6", "name": "network-vif-deleted", "tag": "1525e4e0-7c8b-4fcb-8bbc-bede3d396aac"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:07:10.831551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-f5ba3f64-6953-4bab-954f-5700671b6812 req-37a4431f-235f-4bd5-9588-d81c811f7595 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:10.831551 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-f5ba3f64-6953-4bab-954f-5700671b6812 req-37a4431f-235f-4bd5-9588-d81c811f7595 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:10.843738 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-f5ba3f64-6953-4bab-954f-5700671b6812 req-37a4431f-235f-4bd5-9588-d81c811f7595 service nova] Creating event network-vif-deleted:1525e4e0-7c8b-4fcb-8bbc-bede3d396aac for instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 on hv-cinder-82660 Jun 23 12:07:10.849343 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-f5ba3f64-6953-4bab-954f-5700671b6812 req-37a4431f-235f-4bd5-9588-d81c811f7595 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.195991 Jun 23 12:07:10.850575 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 657/1217] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:07:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:07:11.514104 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:11.514800 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:11.521781 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:11.522226 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:11.523001 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:11.523436 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:11.537661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] HTTP exception thrown: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Request method failure captured: Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 HTTP/1.1 Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFbO65Wq9375RQgwKtptVflH1ZPVKNBz--r_Oo8Zm4yYyuWqjFTN76dI2nExAPyjxicPI-7w1vjRTqKRVakC2NWzjDDNi89akz9JMiEZdL1ksJoidmB44ixqgrVRnMtDRimG3i3cP7_ZmhmLpTfBPRDrj_1DGo9XcwIKINu1KXDvwwM Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:07:11.539324 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 8731c4e543814bcf80075cd315a7b7ff Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:07:11.541567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '81e72538-8ac4-495f-a9c1-b3e80dedede6'} Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:07:11.542479 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:07:11.543888 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:07:11.545201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Returning 404 to user: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:07:11.545201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-10723041-f133-4505-b361-ed416a27bd3b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 404 len: 111 microversion: 2.1 time: 0.031193 Jun 23 12:07:11.545201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 561/1218] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:11 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:07:11.589296 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1356213479", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-220120090", "security_groups": [{"name": "tempest-secgroup-smoke-642463158"}], "block_device_mapping_v2": [{"uuid": "86747eba-38c9-4eeb-b493-2da1186d366f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afd3f766-cce7-48e3-b8ae-4e4ead512081"}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:07:11.710038 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] validate_networks() for [('afd3f766-cce7-48e3-b8ae-4e4ead512081', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:07:12.160468 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:07:12.161124 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:07:12.161383 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:07:12.161796 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:07:12.162210 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:07:12.171922 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:12.172369 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:12.173202 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:12.173656 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:12.191070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for project c41820d2b5eb4dedb313bcef88259676. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:07:12.194975 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for user 8731c4e543814bcf80075cd315a7b7ff and project c41820d2b5eb4dedb313bcef88259676. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:07:12.251631 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:07:12.253871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='86747eba-38c9-4eeb-b493-2da1186d366f',volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:07:12.384187 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-06007abe-6a61-4b82-84bb-d7c40568c18a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.798701 Jun 23 12:07:12.384843 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 658/1219] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 12:07:11 2022] POST /compute/v2.1/servers => generated 405 bytes in 801 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 12:07:12.394757 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-aa7765ec-8af8-406f-a55e-437572ddf314 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:12.395372 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-aa7765ec-8af8-406f-a55e-437572ddf314 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:12.453248 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-aa7765ec-8af8-406f-a55e-437572ddf314 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:12.459918 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-aa7765ec-8af8-406f-a55e-437572ddf314 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1094 microversion: 2.1 time: 0.069005 Jun 23 12:07:12.460481 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 562/1220] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:12 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:13.478070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:13.478888 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:13.487101 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:13.487925 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:13.489013 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:13.489679 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:13.582926 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:13.594004 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3d05c63d-8bc5-4774-816d-2e105707a417 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1210 microversion: 2.1 time: 0.120190 Jun 23 12:07:13.595392 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 659/1221] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:13 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1210 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:14.611333 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:14.611949 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:14.619958 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:14.621603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:14.621603 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:14.621987 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:14.861100 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:14.868922 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-f5c8e91a-a40c-4a9d-ac35-26d7d35185d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.261360 Jun 23 12:07:14.869612 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 563/1222] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:14 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:15.020080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-abdc6e67-f8ca-49f9-94a5-3b6912e4dd1f req-bf20127d-52fe-4ebc-9243-f78288739344 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31b7a33-2272-4a41-aede-b86c37840b61", "tag": "4813358b-0d46-44e8-85ff-ade408ac51db"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:07:15.032610 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-abdc6e67-f8ca-49f9-94a5-3b6912e4dd1f req-bf20127d-52fe-4ebc-9243-f78288739344 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:15.033376 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-abdc6e67-f8ca-49f9-94a5-3b6912e4dd1f req-bf20127d-52fe-4ebc-9243-f78288739344 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:15.053647 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-abdc6e67-f8ca-49f9-94a5-3b6912e4dd1f req-bf20127d-52fe-4ebc-9243-f78288739344 service nova] Creating event network-changed:4813358b-0d46-44e8-85ff-ade408ac51db for instance e31b7a33-2272-4a41-aede-b86c37840b61 on hv-cinder-82660 Jun 23 12:07:15.058917 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-abdc6e67-f8ca-49f9-94a5-3b6912e4dd1f req-bf20127d-52fe-4ebc-9243-f78288739344 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.042432 Jun 23 12:07:15.060291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 660/1223] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:07:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:07:15.886762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:15.887384 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:15.895261 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:15.895720 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:15.896509 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:15.897085 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:16.323215 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:16.330777 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-560ae931-0492-42f5-8228-d2eb1f2f3dda tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.448633 Jun 23 12:07:16.331354 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 564/1224] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:15 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:17.348347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:17.349075 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:17.356303 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:17.356789 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:17.357549 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:17.357980 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:17.488365 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:17.496613 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-975345e0-1f56-4c85-b505-4cbf5692fa57 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.152489 Jun 23 12:07:17.497213 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 661/1225] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:17 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:18.513350 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:18.513996 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:18.520624 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:18.521107 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:18.521882 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:18.522319 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:18.652798 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:18.660573 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c820468e-5072-4de5-aaf6-ffa73fe472b3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.151056 Jun 23 12:07:18.661165 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 565/1226] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:18 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:19.677504 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:19.678112 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:19.685315 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:19.685757 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:19.686510 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:19.686934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:19.818518 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:19.826056 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-cacbe41a-f8cf-425a-871c-6bd55edf0478 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.152688 Jun 23 12:07:19.826611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 662/1227] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:19 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:20.842906 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:20.843464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:20.850012 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:20.850459 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:20.851228 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:20.851666 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:20.980899 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:20.988341 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-295aad55-fb3b-4a00-b590-dd6c5dfafcba tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.149452 Jun 23 12:07:20.988944 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 566/1228] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:20 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:22.005586 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:22.006198 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:22.013221 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:22.013677 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:22.014440 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:22.014879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:22.146268 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:22.153618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-92b80cd9-0121-4836-84e9-4ccff1fee637 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.151867 Jun 23 12:07:22.154208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 663/1229] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:22 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:23.170796 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:23.171492 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:23.173760 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=2 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:23.179966 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:23.181049 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:23.181832 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:23.182265 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:23.319724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:23.327157 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-69b8256a-f2a4-408a-bf70-e4b8b5b19bc5 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.160266 Jun 23 12:07:23.327719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 567/1230] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:23 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:24.343879 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:24.344508 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:24.346484 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:24.347138 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=6 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:07:24.353833 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:24.354281 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:24.355054 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:24.355492 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:24.498341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:24.505712 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1b97bc31-4684-4e34-a03b-112886905459 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.165715 Jun 23 12:07:24.506273 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 664/1231] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:24 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:25.223661 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-b15b106a-a5da-490c-abe3-7920a98c93bf req-eea66177-5761-4c2e-884f-72340ab981db service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31b7a33-2272-4a41-aede-b86c37840b61", "name": "network-vif-plugged", "status": "completed", "tag": "4813358b-0d46-44e8-85ff-ade408ac51db"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:07:25.232762 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-b15b106a-a5da-490c-abe3-7920a98c93bf req-eea66177-5761-4c2e-884f-72340ab981db service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:25.233215 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-b15b106a-a5da-490c-abe3-7920a98c93bf req-eea66177-5761-4c2e-884f-72340ab981db service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:25.245257 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-b15b106a-a5da-490c-abe3-7920a98c93bf req-eea66177-5761-4c2e-884f-72340ab981db service nova] Creating event network-vif-plugged:4813358b-0d46-44e8-85ff-ade408ac51db for instance e31b7a33-2272-4a41-aede-b86c37840b61 on hv-cinder-82660 Jun 23 12:07:25.250326 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-b15b106a-a5da-490c-abe3-7920a98c93bf req-eea66177-5761-4c2e-884f-72340ab981db service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089262 Jun 23 12:07:25.250917 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 568/1232] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:07:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:07:25.524913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:25.525998 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:25.532327 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:25.532758 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:25.533539 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:25.534007 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:25.663959 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:25.671968 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7b33b145-1ef7-4d1d-abeb-f94bbc9ea2df tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1265 microversion: 2.1 time: 0.151443 Jun 23 12:07:25.672546 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 665/1233] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:25 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:26.689897 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:26.690610 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:26.696834 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:26.697277 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:26.698024 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:26.698452 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:26.833813 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:26.841942 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-22c102ec-e1a9-47f5-910b-6cb96f801258 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1452 microversion: 2.1 time: 0.156684 Jun 23 12:07:26.842433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 569/1234] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:26 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1452 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:26.858325 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:07:26.858932 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:07:26.865482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:26.865934 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:26.866703 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:26.867140 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:27.004229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:07:27.012351 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a8d89da0-8923-4ee7-b827-cad32a26f01f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1452 microversion: 2.1 time: 0.158394 Jun 23 12:07:27.012947 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 666/1235] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:07:26 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1452 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:07:28.641267 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-4fbbe2a5-3e45-4dc2-973d-3ae895f5bdd7 req-a6a7d194-326c-4bb3-b1db-78bb145d931a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31b7a33-2272-4a41-aede-b86c37840b61", "tag": "4813358b-0d46-44e8-85ff-ade408ac51db"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:07:28.649218 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-4fbbe2a5-3e45-4dc2-973d-3ae895f5bdd7 req-a6a7d194-326c-4bb3-b1db-78bb145d931a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:07:28.649655 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-4fbbe2a5-3e45-4dc2-973d-3ae895f5bdd7 req-a6a7d194-326c-4bb3-b1db-78bb145d931a service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:07:28.661330 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-4fbbe2a5-3e45-4dc2-973d-3ae895f5bdd7 req-a6a7d194-326c-4bb3-b1db-78bb145d931a service nova] Creating event network-changed:4813358b-0d46-44e8-85ff-ade408ac51db for instance e31b7a33-2272-4a41-aede-b86c37840b61 on hv-cinder-82660 Jun 23 12:07:28.668831 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-4fbbe2a5-3e45-4dc2-973d-3ae895f5bdd7 req-a6a7d194-326c-4bb3-b1db-78bb145d931a service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088526 Jun 23 12:07:28.669317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 570/1236] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:07:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:08:14.735175 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:08:14.736062 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Thu Jun 23 12:08:14 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:09:05.931782 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=42,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:05.932550 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:05.936783 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-216169729", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-220120090", "security_groups": [{"name": "tempest-secgroup-smoke-642463158"}], "block_device_mapping_v2": [{"uuid": "13e4599a-c0fe-40b8-9b25-4e785b0d0094", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "afd3f766-cce7-48e3-b8ae-4e4ead512081"}]}} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:09:06.050253 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.network.neutron [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] validate_networks() for [('afd3f766-cce7-48e3-b8ae-4e4ead512081', None, None, None, None, None)] {{(pid=117746) validate_networks /opt/stack/nova/nova/network/neutron.py:2626}} Jun 23 12:09:06.640511 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Flavor limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 23 12:09:06.640971 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Image limits 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 23 12:09:06.641497 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Flavor pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 23 12:09:06.641839 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Image pref 0:0:0 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 23 12:09:06.642387 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.virt.hardware [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=117746) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 23 12:09:06.651131 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:06.651577 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:06.652371 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:06.652836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:06.671041 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for project c41820d2b5eb4dedb313bcef88259676. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 23 12:09:06.675291 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.quota [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Getting quotas for user 8731c4e543814bcf80075cd315a7b7ff and project c41820d2b5eb4dedb313bcef88259676. Resources: {'cores', 'instances', 'ram'} {{(pid=117746) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 23 12:09:06.735135 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Going to run 1 instances... {{(pid=117746) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 23 12:09:06.737220 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='13e4599a-c0fe-40b8-9b25-4e785b0d0094',volume_size=None,volume_type=None)] {{(pid=117746) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 23 12:09:06.862305 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-c6c580b5-e193-43f1-b32c-8375a32c51da tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.932726 Jun 23 12:09:06.863741 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 667/1237] 10.222.0.67 () {60 vars in 1146 bytes} [Thu Jun 23 12:09:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 935 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 23 12:09:06.872627 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=26 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:06.873391 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=54 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:06.877825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-c238a10a-bc50-449b-902d-e7c060771d33 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:06.878650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-c238a10a-bc50-449b-902d-e7c060771d33 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:06.932295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-c238a10a-bc50-449b-902d-e7c060771d33 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:06.939698 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-c238a10a-bc50-449b-902d-e7c060771d33 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1093 microversion: 2.1 time: 0.069708 Jun 23 12:09:06.940220 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 571/1238] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:06 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1093 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:07.955943 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-393cef84-c4d9-4522-8ef7-c60067742dab tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:07.956563 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-393cef84-c4d9-4522-8ef7-c60067742dab tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:08.013024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-393cef84-c4d9-4522-8ef7-c60067742dab tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:08.024913 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-393cef84-c4d9-4522-8ef7-c60067742dab tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1093 microversion: 2.1 time: 0.072850 Jun 23 12:09:08.025618 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 668/1239] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:07 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:09.042086 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ebc043d6-bde0-4f51-8609-736218f4a1d1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:09.042724 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ebc043d6-bde0-4f51-8609-736218f4a1d1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:09.103038 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-ebc043d6-bde0-4f51-8609-736218f4a1d1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:09.110578 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ebc043d6-bde0-4f51-8609-736218f4a1d1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1093 microversion: 2.1 time: 0.072697 Jun 23 12:09:09.111127 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 572/1240] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:09 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1093 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:10.127482 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-230ecf01-07eb-49f2-b828-4bf22a7ecc01 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:10.128096 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-230ecf01-07eb-49f2-b828-4bf22a7ecc01 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:10.180871 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-230ecf01-07eb-49f2-b828-4bf22a7ecc01 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:10.190991 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-230ecf01-07eb-49f2-b828-4bf22a7ecc01 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1093 microversion: 2.1 time: 0.067694 Jun 23 12:09:10.191569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 669/1241] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:10 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1093 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:11.207545 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:11.208161 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:11.214581 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:11.215028 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:11.215785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:11.216216 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:11.275949 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:11.283551 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-e71bd97a-01db-4b99-aa33-ed6da03eb286 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1143 microversion: 2.1 time: 0.080023 Jun 23 12:09:11.284115 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 573/1242] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:11 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1143 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:12.300208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:12.301339 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:12.310822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:12.310822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:12.311862 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:12.312605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:12.382208 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:12.391450 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3b1c7cc5-f368-4d20-8c57-4ff9020bccde tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1209 microversion: 2.1 time: 0.095076 Jun 23 12:09:12.392034 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 670/1243] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:12 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1209 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:13.278124 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-8d48a820-a487-4ad7-abf3-be4a8b7c5056 req-229c255d-268d-4e90-b9b6-19f80f8476f7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb89068f-56ff-47df-885d-72d786f44cd9", "tag": "d8ccb929-7844-4513-8055-792586e5e2aa"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:09:13.294481 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-8d48a820-a487-4ad7-abf3-be4a8b7c5056 req-229c255d-268d-4e90-b9b6-19f80f8476f7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:13.294931 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-8d48a820-a487-4ad7-abf3-be4a8b7c5056 req-229c255d-268d-4e90-b9b6-19f80f8476f7 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:13.306788 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-8d48a820-a487-4ad7-abf3-be4a8b7c5056 req-229c255d-268d-4e90-b9b6-19f80f8476f7 service nova] Creating event network-changed:d8ccb929-7844-4513-8055-792586e5e2aa for instance bb89068f-56ff-47df-885d-72d786f44cd9 on hv-cinder-82660 Jun 23 12:09:13.311921 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-8d48a820-a487-4ad7-abf3-be4a8b7c5056 req-229c255d-268d-4e90-b9b6-19f80f8476f7 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037857 Jun 23 12:09:13.312666 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 574/1244] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:09:13.409446 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:13.410070 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:13.417115 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:13.417726 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:13.418802 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:13.419311 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:13.561545 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:13.569623 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-a6b20bc2-37dc-4fec-b024-5ca53018b42c tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.164094 Jun 23 12:09:13.570204 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 671/1245] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:13 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:14.587621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:14.588317 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:14.595014 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:14.595456 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:14.596204 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:14.596634 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:14.726605 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:14.734840 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-257b55e6-12ad-4a4e-ab47-6ed1295fa7f2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.151842 Jun 23 12:09:14.735403 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 575/1246] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:14 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:15.751636 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:15.752255 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:15.758909 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:15.759357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:15.760125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:15.760564 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:15.890921 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:15.898347 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-ba461745-2280-4285-812c-d5d41c48396b tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.150827 Jun 23 12:09:15.898920 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 672/1247] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:15 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:16.915483 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:16.916058 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:16.922792 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:16.923246 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:16.924031 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:16.924465 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:17.058308 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:17.066331 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-689b5d50-257b-4b44-a5a1-06e9c4bf7632 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.154857 Jun 23 12:09:17.066983 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 576/1248] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:16 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:18.082337 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:18.082948 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:18.084836 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=2 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:18.090787 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:18.091239 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:18.092005 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:18.092440 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:18.224282 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:18.235916 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1b40f900-7be2-4045-a991-5d6f50df5719 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.157367 Jun 23 12:09:18.236507 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 673/1249] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:18 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:19.253740 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:19.254295 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:19.256760 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell0:SELECT=4 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:19.262089 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:19.263121 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:19.263893 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:19.264338 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:19.394310 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:19.401785 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-940eb33d-3940-4f42-beed-686db835c69a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.152006 Jun 23 12:09:19.402351 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 577/1250] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:19 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:20.418746 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:20.419354 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:20.423331 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell0:SELECT=10 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:09:20.427643 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:20.428085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:20.428964 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:20.429410 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:20.568130 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:20.576630 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-3a0f6af6-8065-40d7-9095-54178c501c20 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.161797 Jun 23 12:09:20.577249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 674/1251] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:20 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:21.593969 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:21.594584 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:21.601212 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:21.601673 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:21.602443 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:21.602875 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:21.733877 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:21.741424 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-5a1181d4-0bb5-46d8-a5fa-917de67675b7 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.151843 Jun 23 12:09:21.741995 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 578/1252] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:21 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:22.758776 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:22.759384 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:22.766184 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:22.766628 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:22.767411 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:22.767824 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:22.902813 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:22.910768 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-4a8bfd47-258e-49a8-98db-aad7b8ad67f1 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.155843 Jun 23 12:09:22.911335 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 675/1253] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:22 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:23.704223 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-810895a4-ad3a-44e2-8580-ad1865ccda98 req-580212ca-48bb-420a-9b6e-36bca5f03105 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb89068f-56ff-47df-885d-72d786f44cd9", "name": "network-vif-plugged", "status": "completed", "tag": "d8ccb929-7844-4513-8055-792586e5e2aa"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:09:23.712890 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-810895a4-ad3a-44e2-8580-ad1865ccda98 req-580212ca-48bb-420a-9b6e-36bca5f03105 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:23.713264 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-810895a4-ad3a-44e2-8580-ad1865ccda98 req-580212ca-48bb-420a-9b6e-36bca5f03105 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:23.725825 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-810895a4-ad3a-44e2-8580-ad1865ccda98 req-580212ca-48bb-420a-9b6e-36bca5f03105 service nova] Creating event network-vif-plugged:d8ccb929-7844-4513-8055-792586e5e2aa for instance bb89068f-56ff-47df-885d-72d786f44cd9 on hv-cinder-82660 Jun 23 12:09:23.730914 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-810895a4-ad3a-44e2-8580-ad1865ccda98 req-580212ca-48bb-420a-9b6e-36bca5f03105 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030937 Jun 23 12:09:23.731510 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 579/1254] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:09:23.927896 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:23.928512 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:23.935196 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:23.936225 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:23.937027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:23.937467 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:24.072380 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:24.079982 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7b354778-8bc7-47ab-8676-9eebd12c67e2 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.156203 Jun 23 12:09:24.080554 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 676/1255] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:23 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:25.097819 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:25.098567 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:25.104850 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:25.105311 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:25.106078 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:25.106517 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:25.236929 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:25.244573 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-a91b8801-0d36-49b1-8ed2-3a6958a56cef tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1264 microversion: 2.1 time: 0.151465 Jun 23 12:09:25.245181 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 580/1256] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:25 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1264 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:26.262086 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:26.262683 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:26.269797 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:26.270249 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:26.271012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:26.271451 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:26.401202 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:26.409470 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-58e9e58c-60d1-4b57-92fb-e5690cf55cdc tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1451 microversion: 2.1 time: 0.151245 Jun 23 12:09:26.410039 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 677/1257] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:26 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1451 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:26.425473 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:09:26.426345 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:09:26.432731 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:26.433178 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:26.433935 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:26.434369 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:26.569543 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:09:26.577641 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-4c1f816a-f2b1-47bd-b197-abbfea6fa5d3 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1451 microversion: 2.1 time: 0.156083 Jun 23 12:09:26.578217 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 581/1258] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:09:26 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1451 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:09:28.253955 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-ffa78d2e-13e7-4cbc-9bf5-775668392c90 req-bb0e49e8-bb81-4d0b-8ed6-63c0a579ba93 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb89068f-56ff-47df-885d-72d786f44cd9", "tag": "d8ccb929-7844-4513-8055-792586e5e2aa"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:09:28.262615 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ffa78d2e-13e7-4cbc-9bf5-775668392c90 req-bb0e49e8-bb81-4d0b-8ed6-63c0a579ba93 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:09:28.263055 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-ffa78d2e-13e7-4cbc-9bf5-775668392c90 req-bb0e49e8-bb81-4d0b-8ed6-63c0a579ba93 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:09:28.274582 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-ffa78d2e-13e7-4cbc-9bf5-775668392c90 req-bb0e49e8-bb81-4d0b-8ed6-63c0a579ba93 service nova] Creating event network-changed:d8ccb929-7844-4513-8055-792586e5e2aa for instance bb89068f-56ff-47df-885d-72d786f44cd9 on hv-cinder-82660 Jun 23 12:09:28.280385 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-ffa78d2e-13e7-4cbc-9bf5-775668392c90 req-bb0e49e8-bb81-4d0b-8ed6-63c0a579ba93 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030188 Jun 23 12:09:28.281029 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 678/1259] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:09:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:09:59.983869 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:09:59.984464 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Thu Jun 23 12:09:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:10:02.153197 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:10:02.153814 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Thu Jun 23 12:10:02 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:10:57.306542 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_api:SELECT=41,nova_api:INSERT=3 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:10:57.307188 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:10:57.307569 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG dbcounter [-] [117746] Writing DB stats nova_cell1:SELECT=52 {{(pid=117746) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:10:57.307670 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:10:57.309978 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_api:SELECT=26 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:10:57.310775 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG dbcounter [-] [117747] Writing DB stats nova_cell1:SELECT=46 {{(pid=117747) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 23 12:10:57.312818 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-dd3922a0-6e3a-4c8b-82c4-7ad0fbc4d19f req-41f18968-52bf-40eb-8d33-a890b4d603bf service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "bb89068f-56ff-47df-885d-72d786f44cd9", "tag": "d8ccb929-7844-4513-8055-792586e5e2aa"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:10:57.317563 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:57.318149 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:57.319002 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:57.319668 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:57.322591 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-dd3922a0-6e3a-4c8b-82c4-7ad0fbc4d19f req-41f18968-52bf-40eb-8d33-a890b4d603bf service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:57.323037 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-dd3922a0-6e3a-4c8b-82c4-7ad0fbc4d19f req-41f18968-52bf-40eb-8d33-a890b4d603bf service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:57.335423 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-dd3922a0-6e3a-4c8b-82c4-7ad0fbc4d19f req-41f18968-52bf-40eb-8d33-a890b4d603bf service nova] Creating event network-changed:d8ccb929-7844-4513-8055-792586e5e2aa for instance bb89068f-56ff-47df-885d-72d786f44cd9 on hv-cinder-82660 Jun 23 12:10:57.341085 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-dd3922a0-6e3a-4c8b-82c4-7ad0fbc4d19f req-41f18968-52bf-40eb-8d33-a890b4d603bf service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036457 Jun 23 12:10:57.341778 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 679/1260] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:10:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:10:57.346828 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:10:57.440409 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-7c79f32e-f176-4879-8d1c-ea0e9a90077f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "DELETE /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 204 len: 0 microversion: 2.1 time: 0.138112 Jun 23 12:10:57.441237 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 582/1261] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:10:57 2022] DELETE /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:10:57.449662 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:10:57.450357 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:10:57.456547 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:57.457023 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:57.458297 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:57.458297 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:57.661627 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:10:57.670780 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-539bfd24-53c8-401f-930f-2b17e4857876 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1576 microversion: 2.1 time: 0.225237 Jun 23 12:10:57.671426 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 680/1262] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:10:57 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1576 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:10:58.690000 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:10:58.690705 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:10:58.698621 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:58.699056 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:58.699818 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:58.700263 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:58.918520 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:10:58.925983 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-33cea17e-44a4-4c7b-a9c0-8c6e9d34d30d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1576 microversion: 2.1 time: 0.240331 Jun 23 12:10:58.926796 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 583/1263] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:10:58 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1576 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:10:59.943535 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:10:59.944078 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:10:59.950747 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:59.951262 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:10:59.952091 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:10:59.952531 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:00.086599 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:11:00.097084 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-029138ca-3b8b-4d03-8a4d-1267934a7a58 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 200 len: 1457 microversion: 2.1 time: 0.157545 Jun 23 12:11:00.097668 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 681/1264] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:10:59 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 1457 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:11:00.179622 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-f32f621e-9948-44a0-a27e-227e217a7cff req-8e8e69f3-3af3-4faa-87f5-d4573e3add10 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "bb89068f-56ff-47df-885d-72d786f44cd9", "name": "network-vif-deleted", "tag": "d8ccb929-7844-4513-8055-792586e5e2aa"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:11:00.190665 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f32f621e-9948-44a0-a27e-227e217a7cff req-8e8e69f3-3af3-4faa-87f5-d4573e3add10 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:00.191274 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-f32f621e-9948-44a0-a27e-227e217a7cff req-8e8e69f3-3af3-4faa-87f5-d4573e3add10 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:00.203780 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-f32f621e-9948-44a0-a27e-227e217a7cff req-8e8e69f3-3af3-4faa-87f5-d4573e3add10 service nova] Creating event network-vif-deleted:d8ccb929-7844-4513-8055-792586e5e2aa for instance bb89068f-56ff-47df-885d-72d786f44cd9 on hv-cinder-82660 Jun 23 12:11:00.209501 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-f32f621e-9948-44a0-a27e-227e217a7cff req-8e8e69f3-3af3-4faa-87f5-d4573e3add10 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034415 Jun 23 12:11:00.210106 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 584/1265] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:11:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:11:01.114418 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:01.115027 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: bb89068f-56ff-47df-885d-72d786f44cd9] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:01.122012 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:01.122397 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:01.123185 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:01.123615 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:01.139211 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] HTTP exception thrown: Instance bb89068f-56ff-47df-885d-72d786f44cd9 could not be found. Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Request method failure captured: Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 HTTP/1.1 Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFbO65Wq9375RQgwKtptVflH1ZPVKNBz--r_Oo8Zm4yYyuWqjFTN76dI2nExAPyjxicPI-7w1vjRTqKRVakC2NWzjDDNi89akz9JMiEZdL1ksJoidmB44ixqgrVRnMtDRimG3i3cP7_ZmhmLpTfBPRDrj_1DGo9XcwIKINu1KXDvwwM Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:11:01.140856 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 8731c4e543814bcf80075cd315a7b7ff Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance bb89068f-56ff-47df-885d-72d786f44cd9 could not be found. Jun 23 12:11:01.142674 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': 'bb89068f-56ff-47df-885d-72d786f44cd9'} Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance bb89068f-56ff-47df-885d-72d786f44cd9 could not be found. Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:11:01.143552 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance bb89068f-56ff-47df-885d-72d786f44cd9 could not be found. Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance bb89068f-56ff-47df-885d-72d786f44cd9 could not be found. Jun 23 12:11:01.145144 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:01.146473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Returning 404 to user: Instance bb89068f-56ff-47df-885d-72d786f44cd9 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:11:01.146473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-f9c0805f-c6a0-495f-93e3-d99bef71744e tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9" status: 404 len: 111 microversion: 2.1 time: 0.031757 Jun 23 12:11:01.146473 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 682/1266] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:11:01 2022] GET /compute/v2.1/servers/bb89068f-56ff-47df-885d-72d786f44cd9 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:11:04.163732 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:04.164386 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:04.165219 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [req-2a249c13-4698-43b0-b1de-249a6390df68 req-d4e3e7a7-e712-4f6b-8bf3-60d2da4d3592 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "e31b7a33-2272-4a41-aede-b86c37840b61", "tag": "4813358b-0d46-44e8-85ff-ade408ac51db"}]} {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:11:04.171657 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:04.172209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:04.173199 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:04.173633 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:04.174103 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-2a249c13-4698-43b0-b1de-249a6390df68 req-d4e3e7a7-e712-4f6b-8bf3-60d2da4d3592 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:04.174661 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [req-2a249c13-4698-43b0-b1de-249a6390df68 req-d4e3e7a7-e712-4f6b-8bf3-60d2da4d3592 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:04.186309 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.compute.server_external_events [req-2a249c13-4698-43b0-b1de-249a6390df68 req-d4e3e7a7-e712-4f6b-8bf3-60d2da4d3592 service nova] Creating event network-changed:4813358b-0d46-44e8-85ff-ade408ac51db for instance e31b7a33-2272-4a41-aede-b86c37840b61 on hv-cinder-82660 Jun 23 12:11:04.192841 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [req-2a249c13-4698-43b0-b1de-249a6390df68 req-d4e3e7a7-e712-4f6b-8bf3-60d2da4d3592 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031233 Jun 23 12:11:04.193560 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 683/1267] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 23 12:11:04.201347 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Going to try to terminate instance {{(pid=117747) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 23 12:11:04.286695 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-ffca04eb-d74e-434d-9337-ee13614bde3f tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "DELETE /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 204 len: 0 microversion: 2.1 time: 0.127468 Jun 23 12:11:04.293523 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 585/1268] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:11:04 2022] DELETE /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 0 bytes in 136 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 23 12:11:04.304656 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:04.305946 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:04.314341 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:04.315095 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:04.316295 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:04.316881 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:04.467620 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:11:04.475312 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-b48d1a6f-7b82-4ba9-959b-6ba26767c01a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1577 microversion: 2.1 time: 0.177037 Jun 23 12:11:04.475880 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 684/1269] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:11:04 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1577 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:11:05.492830 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:05.493671 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:05.500207 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:05.500662 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:05.501461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:05.501898 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:05.661372 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.policy [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117747) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:11:05.670027 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-bde627ab-5afc-4a8a-8e5e-cf917f34f6d0 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1577 microversion: 2.1 time: 0.181993 Jun 23 12:11:05.670604 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 586/1270] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:11:05 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1577 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:11:06.688125 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:06.688782 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:06.690710 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [req-c79d9947-6d28-4ea8-b26d-9dc50cc27b16 req-4f779381-5ee5-446f-82a6-6ad546bc5f06 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "e31b7a33-2272-4a41-aede-b86c37840b61", "name": "network-vif-deleted", "tag": "4813358b-0d46-44e8-85ff-ade408ac51db"}]} {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 23 12:11:06.696345 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:06.696866 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:06.697721 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:06.698803 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:06.700344 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c79d9947-6d28-4ea8-b26d-9dc50cc27b16 req-4f779381-5ee5-446f-82a6-6ad546bc5f06 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:06.700853 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [req-c79d9947-6d28-4ea8-b26d-9dc50cc27b16 req-4f779381-5ee5-446f-82a6-6ad546bc5f06 service nova] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:06.712065 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.compute.server_external_events [req-c79d9947-6d28-4ea8-b26d-9dc50cc27b16 req-4f779381-5ee5-446f-82a6-6ad546bc5f06 service nova] Creating event network-vif-deleted:4813358b-0d46-44e8-85ff-ade408ac51db for instance e31b7a33-2272-4a41-aede-b86c37840b61 on hv-cinder-82660 Jun 23 12:11:06.717580 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [req-c79d9947-6d28-4ea8-b26d-9dc50cc27b16 req-4f779381-5ee5-446f-82a6-6ad546bc5f06 service nova] 10.222.0.67 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030536 Jun 23 12:11:06.718213 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 587/1271] 10.222.0.67 () {64 vars in 1317 bytes} [Thu Jun 23 12:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 23 12:11:06.766454 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.policy [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '8731c4e543814bcf80075cd315a7b7ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c41820d2b5eb4dedb313bcef88259676', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=117746) authorize /opt/stack/nova/nova/policy.py:199}} Jun 23 12:11:06.774024 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-8b254064-fa8c-4e4c-931a-43bce39a9f8a tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 200 len: 1391 microversion: 2.1 time: 0.090676 Jun 23 12:11:06.774590 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 685/1272] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:11:06 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 1391 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 23 12:11:07.792163 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:07.792883 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: e31b7a33-2272-4a41-aede-b86c37840b61] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:07.798992 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:07.799433 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:07.800179 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:07.800605 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:07.815022 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] HTTP exception thrown: Instance e31b7a33-2272-4a41-aede-b86c37840b61 could not be found. Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Request method failure captured: Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 HTTP/1.1 Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFbO65Wq9375RQgwKtptVflH1ZPVKNBz--r_Oo8Zm4yYyuWqjFTN76dI2nExAPyjxicPI-7w1vjRTqKRVakC2NWzjDDNi89akz9JMiEZdL1ksJoidmB44ixqgrVRnMtDRimG3i3cP7_ZmhmLpTfBPRDrj_1DGo9XcwIKINu1KXDvwwM Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:11:07.816554 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 8731c4e543814bcf80075cd315a7b7ff Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance e31b7a33-2272-4a41-aede-b86c37840b61 could not be found. Jun 23 12:11:07.818461 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': 'e31b7a33-2272-4a41-aede-b86c37840b61'} Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance e31b7a33-2272-4a41-aede-b86c37840b61 could not be found. Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:11:07.820209 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance e31b7a33-2272-4a41-aede-b86c37840b61 could not be found. Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance e31b7a33-2272-4a41-aede-b86c37840b61 could not be found. Jun 23 12:11:07.821997 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:07.823569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Returning 404 to user: Instance e31b7a33-2272-4a41-aede-b86c37840b61 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:11:07.823569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-eb637756-d10c-4e82-b100-e8743239aa98 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61" status: 404 len: 111 microversion: 2.1 time: 0.030687 Jun 23 12:11:07.823569 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 588/1273] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:11:07 2022] GET /compute/v2.1/servers/e31b7a33-2272-4a41-aede-b86c37840b61 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:11:08.248064 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:08.248568 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.compute.api [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117746) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:08.257605 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:08.258054 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:08.258812 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:08.259245 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG oslo_concurrency.lockutils [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117746) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:08.272349 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.wsgi [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] HTTP exception thrown: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Request method failure captured: Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: request: DELETE /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 HTTP/1.1 Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept: application/json Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Accept-Encoding: identity Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Connection: close Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Length: 0 Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Content-Type: application/json Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Host: 10.222.0.67 Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Openstack-System-Scope: None Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: User-Agent: python-urllib3/1.26.9 Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Auth-Token: gAAAAABitFbO65Wq9375RQgwKtptVflH1ZPVKNBz--r_Oo8Zm4yYyuWqjFTN76dI2nExAPyjxicPI-7w1vjRTqKRVakC2NWzjDDNi89akz9JMiEZdL1ksJoidmB44ixqgrVRnMtDRimG3i3cP7_ZmhmLpTfBPRDrj_1DGo9XcwIKINu1KXDvwwM Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Id: None Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Domain-Name: None Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Identity-Status: Confirmed Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Is-Admin-Project: True Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Id: default Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Domain-Name: Default Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Project-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Role: member,reader Jun 23 12:11:08.274052 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Roles: member,reader Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-Tenant-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Id: default Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Domain-Name: Default Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Id: 8731c4e543814bcf80075cd315a7b7ff Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: X-User-Name: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: method: > Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: exception: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.275822 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: action_args: {'id': '81e72538-8ac4-495f-a9c1-b3e80dedede6'} Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:11:08.276727 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.278169 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.279729 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Returning 404 to user: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. {{(pid=117746) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:11:08.279729 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-1bbb6f31-7d5d-42f4-b150-7d773d4b9f85 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "DELETE /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 404 len: 111 microversion: 2.1 time: 0.032378 Jun 23 12:11:08.279729 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 686/1274] 10.222.0.67 () {58 vars in 1238 bytes} [Thu Jun 23 12:11:08 2022] DELETE /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:11:08.284016 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '>' {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:08.284719 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.compute.api [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] [instance: 81e72538-8ac4-495f-a9c1-b3e80dedede6] Fetching instance by UUID {{(pid=117747) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 23 12:11:08.291201 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:08.291650 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:08.292413 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 23 12:11:08.292881 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG oslo_concurrency.lockutils [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Lock "33ecd616-f7ab-49ff-9094-00a59936253d" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=117747) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 23 12:11:08.306759 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.wsgi [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] HTTP exception thrown: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Request method failure captured: Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: request: GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 HTTP/1.1 Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept: application/json Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Accept-Encoding: identity Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Connection: close Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Length: 0 Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Content-Type: application/json Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Host: 10.222.0.67 Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Openstack-System-Scope: None Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: User-Agent: python-urllib3/1.26.9 Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Auth-Token: gAAAAABitFbO65Wq9375RQgwKtptVflH1ZPVKNBz--r_Oo8Zm4yYyuWqjFTN76dI2nExAPyjxicPI-7w1vjRTqKRVakC2NWzjDDNi89akz9JMiEZdL1ksJoidmB44ixqgrVRnMtDRimG3i3cP7_ZmhmLpTfBPRDrj_1DGo9XcwIKINu1KXDvwwM Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Id: None Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Domain-Name: None Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Identity-Status: Confirmed Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Is-Admin-Project: True Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Id: default Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Domain-Name: Default Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Project-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Role: member,reader Jun 23 12:11:08.308244 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Roles: member,reader Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Service-Catalog: [{"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/image"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/volume/v3/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2/c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67:9696/"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/compute/v2.1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.67:8080", "publicURL": "http://10.222.0.67:8080/v1/AUTH_c41820d2b5eb4dedb313bcef88259676"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.67/identity"}]}] Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Id: c41820d2b5eb4dedb313bcef88259676 Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-Tenant-Name: tempest-TestVolumeBootPattern-1759797625 Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Id: default Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Domain-Name: Default Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Id: 8731c4e543814bcf80075cd315a7b7ff Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: X-User-Name: tempest-TestVolumeBootPattern-1759797625-project Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: method: > Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: exception: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.310055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: action_args: {'id': '81e72538-8ac4-495f-a9c1-b3e80dedede6'} Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: {{(pid=117747) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 23 12:11:08.311055 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. Jun 23 12:11:08.312687 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: ERROR nova.api.openstack.wsgi Jun 23 12:11:08.314136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: DEBUG nova.api.openstack.wsgi [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Returning 404 to user: Instance 81e72538-8ac4-495f-a9c1-b3e80dedede6 could not be found. {{(pid=117747) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 23 12:11:08.314136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO nova.api.openstack.requestlog [None req-1d907ac3-b52a-4304-bda1-8d9d9bd01f9d tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6" status: 404 len: 111 microversion: 2.1 time: 0.029481 Jun 23 12:11:08.314136 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: [pid: 117747|app: 0|req: 589/1275] 10.222.0.67 () {58 vars in 1235 bytes} [Thu Jun 23 12:11:08 2022] GET /compute/v2.1/servers/81e72538-8ac4-495f-a9c1-b3e80dedede6 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 23 12:11:09.598317 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: DEBUG nova.api.openstack.wsgi [None req-7c27c5ce-8048-4db9-b776-121067603241 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] Calling method '.version_select at 0x7f3aea64dee0>' {{(pid=117746) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 23 12:11:09.620229 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO nova.api.openstack.requestlog [None req-7c27c5ce-8048-4db9-b776-121067603241 tempest-TestVolumeBootPattern-1759797625 tempest-TestVolumeBootPattern-1759797625-project] 10.222.0.67 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-220120090" status: 202 len: 0 microversion: 2.1 time: 0.025753 Jun 23 12:11:09.621405 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: [pid: 117746|app: 0|req: 687/1276] 10.222.0.67 () {58 vars in 1259 bytes} [Thu Jun 23 12:11:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-220120090 => generated 0 bytes in 28 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 23 12:11:34.744005 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:11:34.744503 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Thu Jun 23 12:11:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:13:19.992235 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:13:19.993428 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Thu Jun 23 12:13:19 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:13:33.932080 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:13:33.932637 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Thu Jun 23 12:13:33 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:13:37.012586 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:13:37.013134 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Thu Jun 23 12:13:37 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:14:54.752241 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:14:54.752858 dv-cinder-826608-3-iscsi devstack@n-api.service[117747]: Thu Jun 23 12:14:54 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 23 12:14:59.475036 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 23 12:14:59.475611 dv-cinder-826608-3-iscsi devstack@n-api.service[117746]: Thu Jun 23 12:14:59 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!